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Abstract 

We propose a technique for the design and analysis of adaptation algorithms in dynamical systems. 
The technique applies both to systems with conventional Lyapunov-stable target dynamics and to ones 
of which the desired dynamics around the target set is nonequilibrium and in general unstable in the 
Lyapunov sense. Mathematical models of uncertainties are allowed to be nonlinearly parametrized, 
smooth, and monotonic functions of linear functionals of the parameters. We illustrate with applications 
how the proposed method leads to control algorithms. In particular we show that the mere existence of 
nonlinear operator gains for the desired dynamics guarantees that system solutions are bounded, reach 
a neighborhood of the target set, and mismatches between the modeled uncertainties and uncertainty 
compensator vanish with time. The proposed class of algorithms can also serve as parameter identification 
procedures. In particular, standard persistent excitation suffices to ensure exponential convergence of 
the estimated to the actual values of the parameters. When a weak, nonlinear version of the persistent 
excitation condition is satisfied, convergence is asymptotic. The approach extends to a broader class 
of parameterizations where the monotonicity restriction holds only locally. In this case excitation with 
oscillations of sufficiently high frequency ensure convergence. 

Keywords: nonlinear parametrization, unstable, non-equilibrium dynamics, adaptive control, parameter 
estimation, (nonlinear) persistent excitation, exponential convergence, monotonic functions 



Corresponding author: 

Ivan Tyukin 

Laboratory for Perceptual Dynamics, 
RIKEN Brain Science Institute, 
2-1, Hirosawa, Wako-shi, Saitama, 
351-0198, Japan 

phone: +81-48-462-1111 extension 7436 

fax: +81-48-467-7236 

e-mail: tyukinivan@brain.riken.jp 



*Laboratory for Perceptual Dynamics, Brain Science Institute, RIKEN (Institute for Physical and Chemical Research) , 2-1, 
Hirosawa, Wako-shi, Saitama, 351-0198, Japan, e-mail: {tyukinivan}@brain. riken.jp 
tFord Research Laboratory, Dearborn, MI, 48121, USA, e-mail: dprokhor@ford.com 

* Laboratory for Perceptual Dynamics, Brain Science Institute, RIKEN (Institute for Physical and Chemical Research) , 2-1, 
Hirosawa, Wako-shi, Saitama, 351-0198, Japan, e-mail: {ceesvl}@brain. riken.jp 



1 



1 Introduction 



Results in adaptive control theory and systems identification are most frequently used in control engineering, 
but have potentially a much wider significance. In particular these theories are of great potential relevance for 
sciences such as physics and biology |55) . On the other hand, it is in these areas that the current limitations 
of control theory are most strongly felt. Whereas effective procedures are available in case the system is 
static , [22 , [HS] , , adequate solutions for dynamical systems have been proposed under conditions that 
may not be adequate for most scientific applications. These conditions require that systems are linear in 
their parameters, the target dynamics is stable in the Lyapunov sense, and a Lyapunov function of the target 
dynamics can be given [M], 03] , |3U], [331, Eh [5] . |40| . Each of these restrictions alone is limiting the role of 
control theory in the scientific arena; together they constitute the " standard" approach that confines control 
theory to a limited role, even within the realm of engineering. 

Whereas in artificial system design, nonlinear paramctrizations could often be avoided, physical and 
biological models often require the inclusion of nonlinearly parametrized uncertainties |2] , 0H] , [HI > HU| > 
Proposed solutions to the nonlinear parametrization problem have cemented the standard approach, in that 
they eliminate any hopes of escaping from the stable target dynamics requirement. Nonlinearity is tradition- 
ally solved by invoking dominance of the nonlinear terms |32|. Dominance inevitably overcompensates 
the nonlinearity inherent to the system. This is undesirable if the system's target motions require such 
nonlinearities. It is in particularly unhelpful, in case the system equations embody certain physical laws 
or other regularities that necessitate nonlinear parametrization. Terms overcompensated by dominance are 
likely to be exactly the ones postulated by these laws and regularities. In order to enable nonstable and in a 
sense more delicate target dynamics, more gentle control is needed: one that enables a system to reach the 
desired dynamical state by modification of, rather than destroying, its intrinsic motions. 

Alternatives to dominance are available, but they face a variety of restrictions that make them appear 
less satisfactory. Often they apply to a narrowly defined class of parameterizations, e.g. convex function- 
als as in |18| . When a broader class of nonlinearities is considered, for instance Hammerstain (Wiener) 
models, 01] , [SU] , [201 j 0] , the functions are restricted to static input (output) nonlinearities. Perhaps the 
most promising approach so far involves local linear (nonlinear) modelling techniques [2I>|, [HUh |15| . The 
resulting models, on the other hand, are not always physically plausible. In case fairly general nonlinear 
state dependent functions are allowed ^UJi the class of dynamical systems is limited to those modeled by 
the first-order ordinary differential equations with nonlinear parameterized terms that are Lipschitz in time. 
The last restriction but not least is that the majority of these methods rely on the assumption of stable 
target dynamics. 

There are physical and biological systems, however, which do not meet the requirement of stable target 
dynamics [2J, HI|. Multistability and coexistence of multiple attractors £Q , [SS] , ^2] 1 dEj are well-known 
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examples where a system could, at best, be only locally stable. In biophysics amplification by oscillatory 
instability is believed to be a general mechanism of signal detection in sensory systems Furthermore, as 
demonstrated in |53| , instability (intermittency) offers a solution to the longstanding binding problem in the 
biology of vision |64| . In fact, also in artificial systems unstable target dynamics are sometimes required |53| . 
|4H| . For instance, in |57|. the effectiveness of using chaotic dynamics in solving the path finding problems 
in robotics is shown. In computer science unstable (intermittent) synchrony was shown to be an effective 
paradigm for solving the image segmentation problems 62 . 

Control-theoretic motivation and successful solutions to the problem of adaptive regulation to unstable 
dynamical states are provided in |41j.|42j for linear systems with linear parameterization. For nonlinear 
systems with nonlinear parameterization, and, possibly, unstable target dynamics the problems of adaptive 
regulation and parameter estimation need further development. 

In our present paper we aim to provide a unified tool capable of solving the problems of adaptation and 
parameter estimation 

• in the presence of nonlinear state- dependent parameterization; 

• with non-trivial target sets (namely, surfaces in the systems's state space) 

• with potentially unstable target dynamics, and therefore 

• without requiring for knowledge (or existence) of Lyapunov functions of the desired motions 1 
Previous efforts to deal with nonlinearity by adopting domination functions |31| , |32| , or low-order math- 
ematical models ^U] have tried to address the most general case. In contrast to this, we restrict ourselves 
in advance to a certain class of nonlincarities. This class, however, is wide enough to cover a variety of 
relevant models in physics, mechanics, physiology and neural computation. In particular, it includes models 
of stiction, slip and surface dependent friction, nonlinearities in dampers, smooth saturation, dead-zones in 
mechanical systems, and nonlinearities in models of bio-reactors 0§| j El- |13| . |29j. 

In order to deal with unstable and non-equilibrium target dynamics, without invoking the knowledge 
(or even existence) of the corresponding Lyapunov funcion, we employ operator formalism in the functional 
spaces rather than conventional tools 2 . In particular, we consider desired dynamics in terms of input-output 
mappings in the specific functional spaces. The only requirement we impose on these mappings is existence 
of nonlinear operator gains that bound functional norms of the outputs, given norm-bounded inputs. The 
inputs for these mappings are the mismatches between the modeled uncertainty and a compensator. The 
outputs are the state x and a function ?/>(x, t), not necessarily definite in state, which is considered a measure 
of deviation from the target set. This system-theoretic point of view allows us to formulate the problem of 
adaptation as a problem of regulation of the mismatches to specific functional spaces followed, if possible, 

1 This problem, as mentioned in III . was long remained an open theoretical challenge. 

2 We refer here to common practice to fit the derivative of the goal functionals (Lyapunov candidates) to specific algebraic 
inequalities leading to the property of Lyapunov stability. 
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by minimization of their functional norm. 

We show that the solution to this problem for the given class of parameterizations does not require 
continuity of the corresponding operator gains. This, in turn, suggests that stability of the desired dynamics, 
which in many cases is synonymous to continuity of the input-output operators |68j . is not a necessary 
requirement for our approach. Furthermore, given that ^(x, i) may not be definite, this new point of view 
on the adaptation allows us to lift conventional state-space metric restrictions on the goal functionals 3 . 

Under standard and intuitively clear additional hypotheses (i.e. persistent excitation of a certain func- 
tional of state) , we show that the proposed adaptation procedures solve the problem of parameter estimation 
for nonlinearly parameterized uncertainties. In this case convergence is exponential. The estimates of the 
convergence rates are based on the results of |36j and provided here for consistency. In case the conditions 
specifying the class of nonlinear in parameter uncertainties hold only locally, we show that sufficiently high 
frequency of excitation still ensures convergence. For cases where the standard persistent excitation property 
does not hold, we formulate a new version of nonlinear persistent excitation condition jl(Jj . With this new 
property it is still possible to show asymptotic convergence of the estimates to the actual values of unknown 
parameters. Whether the convergence is exponential is not answered in this paper. 

The paper is organized as follows. Section 2 describes notations and conventions we are using in the 
paper; in Section 3 we formulate the problem. For the sake of compact exposition of our results we restrict 
ourselves to systems that are affine in control, although some non-affine cases are discussed towards the end 
of the paper. Section 4 contains the main results of the paper. We discuss several immediate extensions of 
the present results in Section 5. In Section 6 we provide a practically relevant application of our method, 
and Section 7 concludes the paper. 

2 Notation 

According to the standard convention, symbol R defines the field of real numbers and R> c = {x G R\x > c}, 
R + = R>o; symbol N defines the set of natural numbers; symbol R" stands for a linear space £(R) over 
the field of reals with dim{£(R)} = n; ||x|| denotes the Euclidian norm of x G R ra ; C k denotes the space of 
functions that are at least k times differentiable. Symbol JC denotes the space of all functions k : R + — * R + 
such that k(0) = 0, and that x' > x", x',x" G R+ implies that n(x') - k(x") > 0. By symbol Lp[t ,T], 
where T > 0, p > 1 we denote the space of all functions f : R + — > R™ such that 




3 Which are usually defined as positive-definite and radially unbounded functions of state I17I . I43I . I3UI 
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Symbol ||f || p ,[t ,T] denotes the L™ [to, T] -norm of vector-function f(t). By L^[to,T] we denote the space of 
all functions f : M+ — > R™ such that 

||f||oo,[t ,T] = esssup{||f(i)||,i G [io,? 1 ]} < oo, 

and ||f ||oo, [t ,T] stands for the L^to.T] norm of f(i). 

Let f : R™ — > R m be given. Function f (x) : R" -> R m is said to be locally bounded if for any ||x|| < S 
there exists constant D{8) > such that the following holds: ||f(x)|| < D(5). 

Let F be an n x n square matrix, then T > denotes a positive definite (symmetric) matrix, and is 
the inverse of T. By T > we denote a positive semi-definite matrix. Symbols A m ; n (r), A max (r) stand for the 
minimal and maximal eigenvalues of T respectively. By symbol / we denote the identity matrix. We reserve 
symbol ||x||p to denote the following quadratic form: x T Tx, x G E™. Notation | • | stands for the module 
of a scalar. The solution of a system of differential equations x = f(x, t, 9, u), x(t ) = x , u : R + — > R m , 
9 G R d for t > t will be denoted as x(f, x , t , 9, u), or simply as x(t) if it is clear from the context what 
the values of x , 9 are and how the function u(i) is defined. 

Let u : R n x M. d x M + — ► R m be a function of state x, parameters 9, and time t. Let in addition both x 
and 9 be functions of t. Then in case the arguments of u are clearly defined by the context, we will simply 
write u(t) instead of u(x(£), 9{t), t). 

The (forward complete) system x = f (x, t, 9, u(t)), is said to have an L™[to, T] i— > L™[to, T], gain (T >t , 
p,q G K>i U oo) with respect to its input u(t) if and only if x(t, xo, to, 9, u(t j) G L™[to,T] for any u(t) G 
L™ [to , 7 1 ] and there exists a function such that the following inequality holds: 

l|x(*)llg,[to,n ^ lg,p( x 0,d, \\u(t)\\ p .[ to . T] ) 

Function 7 9iP (x o ,0, ||u(t)|| Pi [t ,T]) is assumed to be non-decreasing in ||u(t)|| Pi [ toi T], and locally bounded in 
its arguments. 

For notational convenience when dealing with vector fields and partial derivatives we will use the following 
extended notion of Lie derivative of a function. Let it be the case that x G M™ and x can be partitioned as 
follows x = xi © x 2 , where xi G M 9 , xi = (in, . . . , xi q ) T , x 2 G W, x 2 = (#21, ■ • • , x 2p ) T , q + p = n, and © 
denotes concatenation of two vectors. Define f : M" — > E™ such that f (x) = f 1 (x) © f 2 (x) , where f 1 : E n — > R q , 
fi(-) = (/n(-),-..,/i g (-)f> f 2 :M"-RP, f 2 (-) = (/21 (■),■■■, / 2p (-)) T - Then symbol L fi(x) ^(x, t), i G {1,2} 
denotes the Lie derivative of function ^(x, t) with respect to vector field fj(x, 9): 

^(x)^(x,t)= d £ XS ^^/ 4J (x,0) 

Symbol sign(-) denotes the signum-function: 

f 1, s > 

sign(s) = < 0, s = 

[ -1, s < 



5 



3 Problem Formulation 



Let the following system be given: 

Xi = fi(x) +gi(x)u, 

x 2 = f 2 (x,0)+g 2 (x)u, (1) 

where 

xi = (x 1 i,...,xi q f G R 9 
x 2 = {x 2 u...,x 2 p) T eW 

X = (Xn, . . . ,Xl q ,X2l, ■ ■ ■ ,X2p) T e R™ 

G Vtg G R d is a vector of unknown parameters, and fig is a closed bounded subset of R d ; u G R is the 
control input, and functions fj : R n -> R«, f 2 : R" x R d -> RP, gl : R" R«, g 2 : R" R p are locally 
bounded. Vector x G 1" is a state vector, and vectors Xi, x 2 are referred to as uncertainty-independent and 
uncertainty- dependent partitions of x, respectively. 

For the sake of compactness we introduce the following alternative description for : 

i = f(x,0)+g(x)u, (2) 

where 

g(x) = On(x), . . . ,g- Lq (x),g 2 i(x), . . . , 52p (x)) T 

f(x) - (/n(x),...,/ lg (x),/ 21 (x,0),...,/ 2p (x,0)) T 

Our goal is to derive both the control function it(x, t) and estimator 9(t), such that all trajectories of the 
system are bounded and state x(i) converges to the desired domain in 1". In addition, we would like to 
find conditions ensuring that the estimate 0{t) converges to unknown 6 G £lg asymptotically. In order to 
ensure boundedness of the trajectories, we should design an input u(x, t) that restricts all possible motions 
of system (|2l to an admissible bounded domain f2 C R™ in the system state space, and if possible steers 
trajectories x(i) to the specific set f2o Q 0- 

As a measure of closeness of trajectories x(i) to the desired state we introduce the error function -0 : 
R" x R+ -> R, 4' G C 1 such that 

!!„ = {x(()el"Wx((),() = 0} (3) 
In conventional theories it is usually required that function -0(x, i) satisfies (algebraic) metric restrictions: 

Vl(||x-€(t)||)<V(x,t)<I^(||x-€(t)||), V!,V2 6 /Coo, (4) 
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where function £ : R+ — » R", £ E C° is, for instance, the reference trajectory. Function i/j(x,t) in this case 
serves as the Lyapunov candidate for the controlled system under the assumption that 6 is known. The 
problem, however, is that finding such a Lyapunov candidate is not a trivial task. Furthermore, the desired 
trajectories £(t) as functions of time may only be partially specified. In case no reference function is available 
(e.g £(t) = 0) and the task is to steer the state x of system to a non-trivial set flo C R", it is often 
difficult to find a goal functional i/>(x, t) such that both © and are satisfied. In addition, in physical and 
nonlinear systems the desired dynamics (e.g. dynamics of convergence of trajectories x(i) to the reference 
could be unstable in Lyapunov sense although it may posess certain degree of attraction |39|. 

and bounded deviation from the reference. 

In order to tackle these complex, but still possible, phenomena we propose to replace the conventional 
goal functionals Q with new and less restrictive ones. In particular, we propose to replace the standard 
norms || ■ || in R™ in with functional norms ||x(i) || p jt ,T] , T > to in the functional spaces L p [to, T], T > to, 
p G R>i U oo. In the other words, we replace algebraic inequality Q with operator relations. This will 
allow us to keep function i/K^ as a measure of closeness of trajectories x(t) to the desired set fio without 
imposing state-metric restrictions (@J on the function f/;(x, i). On the other hand we will be able to derive 
bounds for x(i) from the values of functional £p[icb T]-norms of the function 7/>(x(i),i). Let us formally 
introduce this requirement as follows: 

Assumption 1 (Target operator) For the given function ip(x,t) £ C 1 the following property holds: 

||x(t)|U, [t0 , T] <7(x o ,0,|^(x(t),f)|| oo , [tO)T] ) (5) 
where 7 (xo,0, ||?/;( X (^!M) lloo.[t .T]) * s a locally bounded and non-negative function of its arguments. 

Assumption ^ can be interpreted as a sort of unboundedness observability property [?] of system Q with 
respect to the "output" function t). It can also be viewed as a bounded input - bounded state assumption 
for system along the constraint i/>(x(i, Xo, to, 0, u(x(t), t)), t) = v(t), where signal v(t) serves as the new 
input 4 . In order to illustrate this consider the equations of a spring-mass system with nonlinear damping: 

X\ = x 2 

(6) 

x 2 = k xi + f(x 2 ,t) + u(t), k <0 
where / : R x R + — > R, /(•, •) 6 C 1 is the nonlinear time-varying damping term. Equations of this type 
arise in broad areas of engineering ranging from active suspension control to haptic interfaces |16 | 
and identification of the muscle dynamics |67j. Let the desired dynamics of © be an exponentially fast 
convergence of x\(t), x 2 {t) to the origin. This requirement is satisfied for the following target set: 

flo = {x e R 2 |x : xi + Xx 2 = 0}, A £ K, A > 

4 If, however, boundedness of the state is not required explicitly (i.e. it is guaranteed by additional control or follows from 
the physical properties of the system itself), Assumption Q can be removed from the statements of our results. 
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Therefore, function ip(x,t) could be chosen as ^(x, i) = xi + Xx2- Let ijj{x(t),t) 6 L^^OjT], i. e. x\(t) + 
Xx2{t) = v(t), v(t) G L^ltQjT}. An equivalent description of system JSJ in accordance with this constraint 
is given by 

±1 = -\~ 1 x 1 + \~ 1 v(t), Xx 2 (t) + xxit) = v{t) (7) 

It is clear that system (J7J has the bounded input - bounded state property with respect to input v(t) as 

IM<)IU,[t ,T] < \xi(t )\ + |K*)|U,[ io ,T] and H^WIU.Ito.T] < A -1 (IM*)lloQ,[t ai T] + IK*)IU,[to,T]). This 
automatically implies that Assumption ^ holds for system with tp(x, t) = x\ + Xx-2, A > 0. In particular, 
the following estimate holds 

Kt)IU[to,r| < (1 + X-^lxiih)] + (1 + 2A- 1 )||^(x(t),i)|| OO![t0iT] 

Let us specify a class of control inputs u which, in principle, can ensure boundedness of solutions 
x(t, Xo,io,0, u) for every 6 € fig and xo G M". According to ©, boundedness of x(t, Xo, to, 9, u) is en- 
sured if we find a control input u such that ip(x(t), t) G L^pQ, oo\. To this objective consider the dynamics 
of system @ with respect to ip(x., t): 

4 1 = £f(x,e)^(x,i) +L g(x) -0(x,t)w+ - , (8) 

Assuming that the inverse (L s t x \i/j(x, ij) 1 exists everywhere, we may choose the control input u in the 
following class of functions: 

w(x, 9, u>, t) = (£ g(x) ^(x, i))" 1 ^-£ f(Xi e ) V'(x, - <p(^, t) - ^^f^j , g . 
^ : R x R™ x I + ^ 1 

where w G f2 w C is a vector of known parameters of function ip(ip,uj,t). Denoting L f ( Xj e) , 0(x, t) — 
/(x, 9, t) and taking into account (|5J) we may rewrite equation (JSJ) in the following manner: 

V> = /(x, 0, t) - /(x, 0, t) - <p(ip, u, t) (10) 

Hence, feedback (0 renders the original system Q into the well-known nonlinear error model form |48| 5 . 

In practical applications, state x of original model is hardly ever available. Furthermore, imprecise 
physical models of the processes and measurement noise often lead to the presence of unmodeled dynamics 
in 1)100. Although we do not address these issues in detail in the present article, we do allow additive 
perturbations that are functions of time from L\[t$, oo] in the right-hand side of (|10|l . In particular, instead 
of HI L)|l we consider the following equation: 

j> = /(x, 0, t) - /(x, 9, t) - ipty, u, t) + e(t), (11) 



5 The error models 1101 have proven to be convenient representations of systems with nonlinear parametrization in the 
problems of adaptation 1341 1611 and parameter estimation 1101 



8 



where, if not stated overwise, the function e : R+ — > R, e 6 -^2^0, 00] nC°. One of the immediate advantages 
of (fill) in comparison with l|l(J|l is that it allows us to take the presence of state observers in the system into 
consideration. This clearly widens the range of possible applications of our results. 

Let us now specify the desired properties of function ip(ip,u},t) in @, The majority of known 

algorithms for parameter estimation and adaptive control [541 1431 13T11 14(J| assume global (Lyapunov) stability 
of system ()llfl for 6 = 6. In our study, however, we would like to refrain from this standard and at the same 
time restrictive requirement. Instead we propose that finite energy of the signal /(x(i), 6, t) — /(x(i), 6(t), t), 
defined for example by its L\[to, 00] norm with respect to the variable t, results in finite deviation from the 
target set given by equality ^/>(x, f) = 0. Formally this requirement is introduced in Assumption |5J 

Assumption 2 (Target dynamics operator) Consider the following system: 

i> = -<p{tf,,u,t)+C{t), (12) 

where C ■ — * R and ip(ip,u>,t) is from $11}) . Then for every u> 6 Q. u system fTQjj has L\[tQ, 00] 1— » £^[£0,00] 
gain with respect to input £(0- ^ n ^ e other words, 

C(t) e L\[t ,oo\ => i()(t,i)o,to,u) e 24 [to, 00], tp e R 

and there exists a function 700.2 such that 

ll^(i)lloo,[t ,T] <7oo, 2 (^,w,||C(t)||a,[to,n), VC(*) eL|[t ,T] (13) 

In contrast to conventional approaches, Assumption[5]does not require global asymptotic stability of the origin 
of (unperturbed, i.e for £(t) = 0) system Q12[l. In fact, system l|12f) is allowed to have Lyapunov-unstable 
equilibria. Moreover, there may be no equilibria at all in 112|) . or it can even exhibit chaotic dynamics. 
Examples of such systems, which potentially inherit chaotic behavior but still satisfy Assumption [21 are the 
well-known Lorenz 35 and Hindmarsh-Rose |23| oscillators. The last system models ion current through a 
membrane in the living cell, and is widely used in artificial neural networks, for instance, for processing of 
the visual information |53| . 

When the stability of the target dynamics ip = —ip(ip,<jj,t) is known a-priori, one of the benefits of 
Assumption [21 is that there is no need to know the particular Lyapunov function of the unperturbed sys- 
tem. Apart from being, in some sense, a more friendly and less invasive concept, this enables us to design 
adaptive/parameter estimation procedures for systems with externally-driven uncontrolled multistability 

The differences between conventional restrictions on the goal functionals and alternative requirements 
formulated in Assumptions ^ [3 are further illustrated with Figure 1. For simplicity it is assumed that 

6 In systems with externally driven multistability, i.e. when there are multiple coexistent attractors and trajectories switch 
from one attractor to another depending on the external perturbation, parameter estimation/control algorithms based on the 
knowledge of a specific Lyapunov function require additional information about the instant dynamical state (attractors and 
their allocation) of the system itself. This leads to a necessity to identify current dynamical state of the system prior to 
control/identification of its parameters. 
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V'(x.t)<A l|x(t)IU,[t 0lO o] <A 

Figure 1: Illustration to the choice of the goal functionals ipfe, t). Conventional requirements are illustrated 
with panel a. Requirements following from Assumptions ^ [2] are illustrated with panel b. 

function i/j(x.,t) does not depend on t explicitly and therefore its zeroes form a (set) surface in R™. For the 
conventional approaches this set should additionally satisfy metric conditions Q in R", Fig. 1. a. These 
conditions often restrict class of the possible target sets to the points in R™. In case Assumptions ^ 121 
are satisfied this restriction does not apply any more. Indeed, given that G L\[tQ, oo] we can bound 
H^MtX^Hoo.lto.oo] < 700,2(^0, w, ||C(*)||2,[t ,oo]) = M. Therefore, according to Assumption [3 the state x(t) 
is bounded and belongs to the sphere f2 x = {x G R"| x : ||x(t)|| < 7(xo,0, M) = A}. On the other hand, 
the state x(i) belongs to the domain fl^, = {x G K™ x : \ip(x,t)\ < AI}. This implies that the segments 
of trajectory x(i, Xo, to, 0, u(i)), for t >to will remain in the bounded domain £! x n (shadowy volume in 
Fig. 1. b.) for all t > t . 

The Figure 1 also emphasizes the difference between the proposed operator framework and known ap- 
proaches in adaptive control based on geometrical representations 3 . Indeed, the results based on coordinate 
transformations around the target manifold JSJ are applicable only in a subset of R n where ip(pc,t) does not 
depend explicitly on t, and rank of ip(x,t) is constant. In this respect these results are local. On the other 
hand, Assumptions ^ |21 do not require constant rank conditions and allow both time-varying ip(pc,t) and 
ip(^,u,t). This makes Assumptions QUI a suitable replacement to conventional approaches for systems with 
non-stationary dynamics, or ones which are far away from equilibrium or invariant target manifolds. 

So far we have introduced basic assumptions on system Q dynamics and the class of feedback considered 
in this article. Let us now specify the class of functions /(x, 6,t) in I jllj l. Since general parametrization of 
function /(x, 6,t) is methodologically difficult to deal with but solutions provided for a restricted class of 
nonlinearities (for instance to those which allow linear re-parametrization) often yield physically implausible 
models, we have opted for a new class of parameterizations. This class shall include a sufficiently broad range 
of physical models, in particular those with nonlinear parametrization; the proposed parameterizations will 
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Figure 2: Illustration to Assumption |21 for the nonlinear in parameters function /(x, 0,i) — / m (</>(x) T 0, i), 
/,„:lxl + ^ K. Thick lines stand for the function A/L>0(x) T 0, D — max x ,t \Dq(x, f)| in each block 
respectively. 

also, in principle, be able to handle arbitrary state nonlinearity in the class of functions from C . As a 
candidate for such a parametrization we suggest nonlinear functions that satisfy the following assumption: 

Assumption 3 (Monotonicity and Growth Rate in Parameters) For the given function f (x, 9 , t) in 
Ull}) there exists function a(x, t) : R™ x M. + — > M d , a(x, t) £ C 1 and positive constant D > such that 

(/(x, 9, t) - /(x, 9, i))(a(x, t) T (0 - 0)) > (14) 

|/(x, 0, t) - /(x, 0, t)| < D|a(x, t) T (0 - 0)| (15) 

The first inequality l|14l) in Assumption [3] holds, for example, for every smooth nonlinear function which is 
monotonic with respect to a linear functional <p(x.) T 9 over a vector of parameters: 

/(x,0,i) = / m (x,0(x) T 0,i) 

sign I — I = const 

Hence function a(x, t) satisfying (|14|) could be chosen in the following form: a(x, t) = M0(x)k(x, t), where 
k : W 1 x R+ -> M + , k(x, t) G C 1 . 

The second inequality, (|15|l . is satisfied if the function /(x, <p(x) T 9, t) does not grow faster than a linear 
function in variable tfi(x) T 9 for every x G W 1 . This requirement holds, for example, for those functions 
/(x, 4>(x) T 9,t) which are globally Lipschitz in <p(x) T 9: 

|/ m (x,<Kx) T 0,i) - / m (x,<Kx) T 0',t)| < D g (x,t)\ct>(x) T (9 - 9')\ 

In particular, inequalities (|14fl . H15|) hold for the function /(x, 0(x) T 0, £) with ct(x, i) = MDg(x,t)<p(x.). A 
graphical illustration of the choice of function ct(x, t) is given in Figure 2. 

This set of conditions naturally extends from systems that are linear in parameters to those with nonlinear 
parametrization. Assumption [3] covers (at least for bounded 9,9 G fie) a considerable variety of practically 
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relevant models with nonlinear parametrization. These include effects of stiction forces 0, slip and surface 
dependent friction given by the "magic formula" |49| or physics-inspired model of the tyre UJ, nonlinear 
processes in dampers for automotive suspension |29| . smooth saturation, and dead-zones in mechanical 
systems. It further includes nonlinearities in models of bio-reactors UJ. The class of functions /(x, 
specified in Assumption |3| can also serve as nonlinear replacement of functions that are linear in their 
parameters in a variety of piecewise approximation models. Last but not least, this set of functions includes 
sigmoid and Gaussian nonlinearities, which are favored in neuro and fuzzy control and mathematical models 
of neural processes . Table 1 provides some of the parametric nonlinearities that occur in these processes 
and their corresponding functions a(x, t). 



Table 1: Examples of nonlinearities satisfying Assumption [3J Parameters Ag, A r are positive constants 



physical meaning 


mathematical model 
of uncertainty /(x, 8, i) 


domain of 
physical 
relevance 


a(x, t) 


stiction forces 


x = (xi, x 2 ) 


Ag > 6 O ,0i > 

x G R 2 


a(x,t) = (-x'ilf 


tyre-road friction P| 


"0 q x 3 

fnsign(a;2) j» 4'7r 

/ |rx 2 x 3 | \ 

G = 9 I no + (Ms - no)e ' — 

X = (X1,X2,X3) 

F n ,ao,jj,s,nc > - parameters 
MS > nc 


Ag > > 

Xl,X2 > 

x s G (0, 1) 


«(*,*) = t3j 


force supported by 

hydraulic emulsion 
in suspension 
dampers |29| 


K o (0+l)A p (x 1 -x 2 ) 
X = (xi,X2,X 3 ) 

K , A p , P , L > - parameters 


Ag > 6 > 

x 3 > 


a(x,t) = A p (a;i - x 2 ) 


nonlinearities in 
Monod's growth model 
of microorganisms 


X-1X2 X1X2 

e +e 1 x 1 > e +e 1 x 2 
x = (xi, x 2 ) 


Ag > 6» , 6»i > 

Xl,X2 > 


a(x, i) = xiX2{l, xi) T 
a(x, i) =3:1X2(1, £2) T 


blur distortion model 
in networks 
for processing 
of visual information 


r iyj : R + -> R+, i,j,n G N 
i c ,jc € N, 1 < i c ,jc < n 


A s > > 

IKj(<)|| »,[*(,, °°] < A r 


a(x, t) = 1 



Assumption|31bounds the growth rate of the difference |/(x, 6, t)— /(x, 0, i)| by the functional D|a(x, t) T (8— 
8) I . This will help us to find a parameter estimation algorithm such that the estimates converge to 8 suffi- 
ciently fast for the solutions of QJ, to remain bounded with non-dominating feedback On the other 
hand, parametric error 8 — 8 can be inferred from the changes in the variable i/j(x, i), according to (|1 1|) . 
only by means of the difference f(x,8,t) — f(x,8,t). Therefore, as long as convergence of the estimates 6 
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to is expected, it is also useful to have the estimate of /(x, 0,i) — /(x, 0,t)| from below, as specified in 
Assumption : 

Assumption 4 For the given function /(x, 0,i) in and function a(x, t), satisfying Assumption^ there 
exists a positive constant D\ > such that 

|/(x,0,t)-/(x,0,t)| >£>i|a(x,i) T (0-0)| (16) 

In problems of parameter estimation, effectiveness of the algorithms often depends on how "good" the 
nonlinearity /(x, 0, t) is, and how predictable locally is the system's behavior. As a measure of goodness and 
predictability usually the substitutes as smoothness, boundedness, and Lipschitz conditions are considered. 
In our study, we distinguish several such specific properties of functions /(x, 0,t) and (p(ip,u),t). These 
properties are provided below 

H 1 Function /(x, 0,i) is locally bounded with respect to x, uniformly in t. 

H 2 Function /(x, 0,i) £ C , and df{~x.,8,t)/dt is locally bounded with respect to x, uniformly in t. 

H 3 Function /(x, 0,i) is globally Lipschitz with respect to uniformly in x, t; 

3C«>0: |/(x,0,i)-/(x,0»| <A,||0-0|| 

H 4 Lei f/a, C K™, J7g C K rf be given and U x , Ug are bounded. Then there exists constant Du K ,u 9 > such 
that for every x £ U x and 6,6 £ Ug Assumption^ is satisfied with D\ = Du xt u e . 

H 5 Function (p(ip,u),t) is locally bounded in ip, u) uniformly in t. 

In the next section we present novel algorithms for adaptive control and parameter estimation in nonlinear 
dynamical systems @ which satisfy Assumptions^ElEl and^J We show that under an additional structural 
requirement, which relates properties of function a(x, t) and vector-filed f(x, 0) = fi(x, 0) © fa(x, 0) in QJ, 
(0), the following desired property holds: 

x(t)eL»[to,oo]; /(x(i),0,t)-/(x,0(t),i) £^[t ,oo] (17) 

After boundedness of the solutions is guaranteed, we prove that 

lim ip(x(t),t) = 

t — >oc 

In addition, we show that 

lim 0(i) = (18) 

t — >oo 

In particular we demonstrate that the standard persistent excitation condition is sufficient to guarantee the 
convergence. Furthermore, in the case that Assumptions I3I4| hold only locally (for x from a domain of R") 
we demonstrate that sufficiently high excitation in the system still leads to the desired estimates. 

7 Despite Assumption |3] requires that 1161 holds for every x £ R™, 8 £ ffi d , and t £ VL+, we will see later that for a variety of 
problems it is sufficient that it is satisfied only locally. 
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4 Main Results 

Standard approaches in parameter estimation and adaptation problems usually assume feedback and a 
parameter adjustment algorithm in the following form 

u = u(x, 9, t) 

(19) 

= .A lg (V>,x, t) 

The most favorite strategy of finding these, known also as certainty- equivalence principle, is a two-stage design 
prescription. First, construct uncertainty-dependent feedback u(x, 0, t), 9 ^ fig which ensures boundedness 
of the trajectories x(i). Second, replace with 9 in u(x, 9, t) and, given the constraints (e.g., x, 9 cannot be 
measured explicitly, while state x is available), design function _4i g : E x K™ x R + — ► M. d which guarantees 
(113, |(TBll, or/and ^>(x(t),f) -> 0. 

With this strategy, the design of the feedback u(x, G, t) is generally independent 8 of the specific design 
of the parameter estimation algorithm A\ s (ip, x, t). This allows the full benefit of contemporary nonlinear 
control theory ["2] [i""5] "23 05] in designing feedbacks u(x, 9,t). On the other hand, this strategy equally 
benefits from conventional parameter estimation and adaptation theories |33U 161 14*31 14(J| which provide a list 
of the ready-to-be-implemented algorithms under the assumption that feedback u(x, 8,t) ensures stability 
of the system. 

Ironically, the power of the certainty-equivalence principle - simplicity and relative independence of the 
stages of design - is also its Achilles' heel. This principle does not take into account the possible interactions 
between stabilizing control and parameter estimation procedures. It has been reported in |561 l47l l"Hl(jl| that 
an additional "interaction" term 9p(x,t) : W x R + — > HL d added to the parameters 9 in function u(x, 0, t): 
ti(x, 9 + 0p(x, t),t) introduces new properties to the system. Unfortunately, straightforward introduction 
of this "interaction" term as a new variable of the design affects its simplicity, internal order, and so much 
favored independence of the design stages (control and estimation). 

An alternative strategy which introduces a new design paradigm is proposed in 58 , 52] . Its main idea is 
that adaptation algorithms in (|19fl are initially allowed to depend on unmeasurable variables tp, x, 9 

9 = At s (i>,ip,x,±,e,t) (20) 

For this reason we refer to such algorithms as virtual algorithms. If the desired properties (|17f) . I|18l) are 
ensured with H2(J[I then, taking into account properties of the vector-fields f(x, 9), g(x) in ""J}, we convert 
the unrealizable algorithm l|2(J|) into an equivalent representation in integro-differential, or finite, form |19|: 

9 = r(0 P (x, t) + 9i{t)), r g m. dxd , r > o 

(21) 

9 1 = Ai s (tp , x, t) 

s In particular, it is the standard requirement that function u(x, 8, t) should guarantee Lyaponov stability of the system for 
8 = 0, while parameter adjustment algorithms use this property in order to ensure stability of the whole system. No other 
properties are required from the function u(x, 8, i). 
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This approach preserves the convenience of the certainty-equivalence principle, as the feedback it(x, 0, t) 
could, in principle, be built independently of the subsequent parameter adjustment procedure. At the same 
time, it provides the necessary interaction term 6p(x, t) ensuring the required properties (|17|l . 1)18(1 of the 
closed-loop system even if function /(x, 0, t) in i|ll|) is nonlinear in 0. 

In this paper we propose the following class of virtual adaptation algorithms 9 : 

'b = v{i> + oj, t))a(x, t) + Q(x, e,t)(0-e), re R dxd , r > o (22) 

where Q{x,0,t) : R" x R d x R+ -> R dxd , Q(-) e C°. As a candidate for finite form realization J2U of 
algorithms 122|) we select the following set of equations: 

0(x, t) = r(d P (x, t) + bi{t))\ r e R dxd , r > 

0p(x,t) = ^(x f t)a(x,i)-*(x,i) (23) 
0/ = <^(V>(x, t), w, i)a(x, t) + TZ(x, 0, u(x, 0, t),t), 
where function *(x,t) : R™ xl + ^ R d , *(x,t) e C 1 satisfies Assumption 

Assumption 5 There exists function ^(x, t) suc/i £/ia£ 

ax 2 dx 2 

where B(x,t) : 1" x R + — > R dxp is either zero or, j/f 2 (x, 0) is differ entiahle in 9, satisfies the following: 

B(x, t)^"(x, 0, 0') > V0, 0' G x e R" 

■r(x,e,e') = / l af2(x ' s(A)) dA, s(a) = 0'a + 0(i-a) 

os 

Function ?e(x, 0, u(x, 0, i), £) : R" x R d x R x R + — » R d in Q is given as follows: 

K(x,u(x,0,t),t) = d#(x,t)/dt- ip(x,t)(da(x,t)/dt) - 

(ip(x,t)L fl a(x,t) - L fl *(x,t)) - (V>(x,£)£ gl a(x,£) - L gl *(x,t))u(x, 0,i) 
+B(x, t)(f 2 (x, 0) + g 2 (x)u(x, 0, t)). (25) 

Functions ^(x, i) and 7£(x, 9,u(x,0,t),t) are introduced into (|23[) in order to shape the derivative 0(x, i) to 
fit equation (|22|l . The role of function ^(x, i) in l|23(l is to compensate for the uncertainty-dependent term 
^>(x, t)Lf 2 r x 0\cx.(x ) t), and equation l|24|l is the condition when such compensation is possible 10 . With the 
function TZ(x, , u(x, , t) , t) we eliminate the influence of the uncertainty-independent vector fields fi(x), 
gi(x), and g 2 (x) on the desired form of the time-derivative 0(x, t). The properties of system Q, together 
with control I0 and this new adaptation algorithm l|23|) . I|25ll . are summarized in Theorem ^ ari< i Theorem 

m 

9 Choice of the virtual algorithm in the form of equation 1221 is motivated by our previous study of derivative-dependent 
algorithms for systems with uncertainties that are nonlinear in their parameters 1521 Hill 

10 We show below, in the proof of Theorem HI fsee Appendix), that Assumption 151 is indeed sufficient for the function 0(x, t) 
to be a realization of 1221 . 
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Theorem 1 (Boundedness) Let system 1^11)) . I25p be given and Assumvtions\,°-^Jj5\ be satisfied. 

Then the following properties hold 

PI) Let for the given initial conditions x(to), 0i(to) and parameters vector 0, interval [ta,T*] be the 
(maximal) time-interval of existence of solutions in the closed loop system (7)). }25\) . Then 

/(x(t), 0, t) - /(x(t), d(t), t)) e L\[to, T*] 



and 



||/(x(t),fl,t)-/(x(t),e(t),t))|| ai[t0 , r . ] <D / (e,to,r,|| e (t)|| 2 , [to , r . ] ); 



/; „ 2 \ 05 d 



D/(e s *o s r,||e(t)|| 2 , [tol r.])= I j\\e - 0(hm-i J + ^-IkWIb.^.T-l (26) 



le-dWHJ-^ll^toJ-C-x + ^slK*) 112 



2^2ll c V b ;il2,[to,T«] 



'1 

In addition, if Assumptions^] and\^ are satisfied then 
PS) ^(x(i),t) G Ljjto.oo], x(i) 6 I&,[to,oo] 

||V(x(t), t) ||oo,[t ,oo] < 7oo,2 (V(X0, to), W, to, T, ||e(t)|| 2 ,[ to ,oc]) + ||e(t) II 2,[ t0 ,oo]) (27) 

P3) if properties -fQ i0 /io?d, and system has L\[t$, oo] i— > Lp[io,oo], p > 1 join ura't/i respect to 
input cmd output ip then 

[to,oo] =>■ lim ip(x(t),t) = (28) 

t — >oc 

//, m addition, property L^holds, and functions a(x, f), dip(x,t)/dt are locally bounded with respect to 
x uniformly in t, then 

P4 ) the following limiting relation holds 

lim /(x(i), 0, t) - /(x(t), 0(t), t) = (29) 

r — >oo 

Proofs of Theorem ^ and subsequent results are given in the Appendix. 

Before we proceed with discussion of the results of Theorem ^ we wish to comment on Assumption 
Assumption[S]lmks the possibility to design the parameter adjustment algorithm in the form of equation l|22|) . 
with the properties of functions ct(x, t) and ^>(x, t). These functions depend on the properties of nonlinearity 
/(x, 0, t) itself (function ct(x, f)) and, importantly, on the chosen specification of the desired target set: 

{x e E n |^(x,t) = 0} c Q 

given by function ip(pc,t). Specific properties of the functions /(x, 8,t) and tp(x., t) are interrelated through 
the possibility to solve partial differential equation (|24|) for the function ^(x, t). Let 23 (x, t) = col(23i(x, t),. . . , 
23<j(x,i)), and o:(x,t) € C 2 , cc(x,t) = col(ai(x,i), . . . ,Q!d(x,t)), then necessary and sufficient conditions for 
existence of the function ^(x, t) follow from the Poincare lemma: 

T 

(30) 



d ( ,, , 9«i(x, t) „. A { d { ,, , 9aj(x, t) „. 
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This relation, in the form of conditions of existence of the solutions for function ^(x, t) in l|24(l . takes into 
account structural properties of system £[]), Ijlll) . Indeed, let B(x,t) — and consider partial derivatives 
da.i(x,t)/dx2, 9^(x, i)/c>X2 with respect to vector X2 = (2:21, ■ • ■ ,X2p) T - Let 

cV(x,i) 

= iu u ••■ U * u ••• U I 

(31) 



= (0 ••■ * •■• 0) 

ox 2 v ' 



^M = (o ... * ... 0) 

ox 2 v ' 

where symbol * denotes a function of x and t. Then condition (|31jl guarantees that equality (|3t)|> (and, 
subsequently, Assumption |SJ) holds. Whether or not Assumption [S] holds, depends, roughly speaking, on 
how large is the part of partition X2 that enters the arguments of functions -0(x, i), a(x, t). In the case of 
da (xi ®X2,f) /<9x2 = , Assumption holds for arbitrary f(x,t) e C 1 . If ip(x, t) , a(x, t) depend on just a 
single component of X2, for instance x 2 k, k s {0, . . . ,p}, then conditions H31|) hold and function \&(x, t) can 
be derived explicitly by integration 

*(x,«)= / ^t)^p^dx 2k (32) 

J OX 2 k 

In all other cases, the existence of the required function ^(x, t) follows from l|3U|) . 

The necessity to satisfy Assumption [5] may seem to be a critical restriction, which limits applicabil- 
ity of our approach. However, we notice that it holds in the relevant problem settings 11 for arbitrary 
ct(x,t),ijj(x,t) eC 1 . Consider, for instance JUli where the class of systems is restricted to (|33f) : 

x = —q(x, u)x + f(0, u, x), g(x, t) > p m in > 0, x£l (33) 

The dimension of the state in system l(33|) coincides with that of the uncertainty-dependent partition and 
equals to unit (dim{x} = dim{x2} = 1). Hence, according to l|32l) . and in case functions ip(x, t), a(x, t) £ C 1 , 
there will always exist a function ^(x, t) satisfying equality 124(1 with B(x, t) = 0. 

In the general case, when dim{x2} > 1, the problems of finding function \&(x, t) satisfying condition (|24j) 
can be avoided (or converted into one with an already known solutions such as H3U|) . (|32|l ') by the embedding 
technique proposed in |59j . The main idea of the method is to introduce an auxiliary system 

£ = f C (x,£,t), £ ER Z 

(34) 

h 5 = h(:(£,t), I z xl + ^ R h 

such that 

/(x(t), 9, t) - /( Xl (t) © h 6 (t) © x 2 (t), 9, t) G L\[t , oo] (35) 
and dimjhj} + dim{x 2 } = p. Then (|llfl can be rewritten as follows: 

</> = /( Xl © h 5 © x 2 , 8, t) ~ /( Xl © \ © x 2 , 9, t) - ipty, w, t) + e € (t), (36) 



11 See, for example, the problem setting in I1UI for parameter estimation in the presence of nonlinear state-dependent 
parametrization. This problem setting, according to our knowledge, is by far one of the most general available in the lit- 
erature. 
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where e^(t) 6 L 2 [io,cw], and dim{x 2 } = p — h < p. In principle, the dimension of x 2 could be reduced 
to 1 or 0. As soon as this is ensured, Assumption (5J will be satisfied and the results of Theorem 2] follow. 
Sufficient conditions ensuring the existence of such an embedding in general case are provided in |59*i . For 
systems in which the parametric uncertainty can be reduced to vector fields with low-triangular structure 
the embedding is given in |t>U| . 

An alternative way to construct system (|34|l with the desired properties is to use (possible, high-gain, 
discontinuous) robust observers. In order to illustrate this approach consider the rather general case when 
function fa(x, 9) in is given as fa(x, 9) = fa(x) + 0(x, 9), and function </>(x, 9) is bounded. 

Let in addition there exist continuous functions h e : MP — > R p , : M p — > MP such that the following 
inequality is satisfied 

IMe-x 2 )|| > |/(x 1 eh € (€),e,t)-/(x 1 ex 2 ,e,t)| (37) 

As a candidate for yet unknown tracking system <(3^|l we select the following 

£ = f(x)+f e (£-x 2 )+g 2 (x) U + i; (38) 

where function f £ : MP — ► MP and auxiliary input «gP are the design parameters. Subtracting equations 
for x 2 in Q from l|38|) yields: 

e = f e (e)-0(x(i),0)+u 

(39) 

y e = Me) 

where e = £ — x 2 . Let us finally choose the function f e in l|39[l such that the system e = f e (e) + v is strictly 
passive with a positive definite storage function V(e,t) : 

V(e,t) <y^-/?||y e || 2 , 0>O (40) 

According to !37. 12 (page 1484, Theorem 2) inequality (|40|l guarantees that there always exists input v(t) 
in 138|l such that h e (e(t)) S if^QjCX)]. Then taking into account 1)3 7|) we can conclude that condition (1351) 
holds (with x' 2 : dim{x 2 } = 0). This implies that the original error model l|llf) can be converted into l|36|) . 
which in our case satisfies Assumption \5\ {dai (x, i)9x 2 = for the corresponding a^(x, i) in ) - 

Let us now briefly comment on the results of Theorem ^ The theorem ensures a set of relevant proper- 
ties for both control (P2, P3) and parameter estimation problems (PI, P4). These properties, as illustrated 
with (|26[) - l|29[) . provide conditions for boundedness of the solutions x.(t,XQ,to,6,u(t)), reaching the tar- 
get set £lo, and exact compensation of the uncertainty term /(x,0,t) even in the presence of unknown 
disturbances e(t) e L 2 [to7°°] H L^to, oo}. These characterizations are the consequence of the fact that 
(/(x(t), 9,t) - /(x(i), 9(t),t))) G L\[t.Q, oo], which in turn is guaranteed by properties fity. lfl3|) . (JTBJ of the 

12 In 1371 one extra assumption on the function f f (e) in 1391 is imposed. In particular it is required that the system e = 
f e (e) + « is strongly zero-detectable with respect to inputs v and output y e . In our case, however, the limiting relations 
limt— 10 o y e (t) = 0, limt^oo e(t) = are not necessary. Therefore, as follows from the proof of Theorem 2 in 1371 . in order to 
show just ||ye(t)|| S Lj^coo] the assumption of strong zcro-delcctability can be omitted. 
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function f(x,9,t) in Assumptions El Among these properties, estimate l|16|l in Assumption 01 is particu- 
lary important for allowing disturbances (potentially unbounded) from L^to, oo]. When no disturbances are 
present it is possible to show that P1-P4 hold without involving Assumption 0J 

Corollary 1 Let system 0), ifiijj . ifgg)) . if £5)) be given, e(t) = 0, and Assumvtions \Slb\ hold. Then 

P5) norm \\9 — 9(t)\\'^_ 1 is non-increasing and properties P1-P4 13 of Theorem^ hold with e(t) = 
respectively. 

In addition to the fact that \f(x,9,t) — f(x,9,t)\ is not required to be bounded from below as in l|ltj|) . 
Corollary ^ ensures that \\9 — is not growing with time when e(t) = 0. The practical relevance of 

the corollary is that it will allow us to guarantee desired convergence (|18|l with a much weaker, local version 
of Assumption It will also help us to establish conditions for (semi-global) exponential stability in the 
unperturbed system, which in turn will enable (small) disturbances from L^^OjOo] in the right-hand side 
of CEU). 

Another consequence of Theorem ^ concerns the specific case when e(t) <E L^to, 00} n i^o, 

Corollary 2 Let system Qj, fH)) . f^)) . 1^5)) be given, AssumptionsUNMBhold, e(t) e L^to, ooJnL^o, °°], 
and property holds. Let in addition, system has Lp[tQ, 00] 1— > Lj^^o, 00], p > 2 gain. Then 
P6) tf(x(t),i) G L^oo], x(t) G L» [to.oo]; 

PI) if properties W^hold, and system has L* [to, 00] >— > Lj[t 0) oo], g > 1 5am wra'f/j respect to 
input £(t) cmd state ip, then limt_ ) . 00 ip(x(t), t) = 0; 

If in addition property L\^is satisfied, functions a(x,t), dip(x,t)/dt are locally bounded with respect to 
x uniformly in t, then limiting relation \2ty holds as well. 

Corollary [3 extends applicability of algorithms J32J, l(2"B|) to systems l(TT|) with defined Lp[t , 00] 1— > L^to, 00] 
gains for arbitrary p > 2. 

Let us formulate conditions ensuring convergence of the estimates 9(t) to 9 in the closed loop system 
0, d) , l|23(l . i|25|) . When the mathematical model of the uncertainties is linear in its parameters, i.e. 
f{x,9,t) = C(x,i) T 0, the usual requirement for convergence is that signal £(x(t),f) is persistently exciting 

Definition 1 (Persistent Excitation) Let function £ : M + — » R k be given. Function £(t) is said to be 
persistently exciting iff there exist constants 5 > and L > such that for all t £ M + f/ie following holds 

C(r)C(r) T dT>SI (41) 

13 In this case, however, the bound for ||i/>(x(t), i)||oo,[t ,oo] wm De different from the one given by equation 1271 in Theorem 
IT1 Its new estimate is given by formula 1771 in Appendix 1 
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The conventional notion of persistent excitation requires specific properties (i.g. the integral inequality (|41|l ) 
from signal as a function of time. In the closed loop system, however, relevant signals in the model of 
uncertainty /(x, 6, t) can depend on state x and parameters. In particular, they depend on initial conditions, 
parameters of the feedback, and initial time to- In order to address this issue it is suggested in |3b| to use 
the notion of uniform persistent excitation: 

Definition 2 (Uniform Persistent Excitation) Let function £ : R"xR + — > M. k be given, andx.(t, Xo, to, 9o) 
be a solution of where the vector 60 G M s stands for all possible parameters of £7J) and feedback 0). 
\2ty . \25§. Function £(x(t, Xo, to, #o), t) is said to be uniformly persistently exciting iff there exist constants 
6 > and L > such that for all t, to G R+, Xo G R n , #o G K s i/ie following holds 

rt+L 

J C(x(r, xo, to, 6> ), r)C(x(r, x , t , O ), r) T dr > <J/ (42) 

When dealing with nonlinear parameterization, it is also useful to have a characterization which takes into 
account nonlinearity in the model. In the linear case, persistent excitation of signal £(x(t),t) (inequality 
l|4ipl implies that the following property holds 

3t'G[t,t + L]: |C(x(O,O T (0i -02)| ><$||0i -9 2 \\ (43) 

In the other words, the difference |£(x(f), t) T (^i — 0a) | is proportional to the distance — 02|| in parameter 
space for some t' G [t, t + L]. In the nonlinear case it is natural to replace the linear term £(x(t'), t') T (9i —62) 
in (|43|l with its nonlinear substitute /(x(i'), 0i, f') — /(x(t'), 02, t') as has been done, for example, in [TU| 
for systems with convex/concave parametrization. It is also natural to replace the proportion 5\\8i — 62 \\ in 
the right-hand side of (|43|l with a nonlinear function. Therefore, as a candidate for the nonlinear persistent 
excitation condition we propose the following notion: 

Definition 3 (Nonlinear Persistent Excitation) The function /(x(t),0,t) : M™ x R d x R + -> K is said 
to be persistently excited with respect to parameters 9 G £1$ C K d iff there exist constant L > and function 
g : R + — > R + , p G K- D C° such that for all t G , 0i, #2 G fig tfte following holds: 

3t' e[t,t + L}: \f(yL(t'),O 1 ,t')-f(x(t'),0 2 ,t')\> Q (\\O 1 -e 2 \\) (44) 

Properties l|41|l and (|44|l in Definitions 2] and [31 can be considered as alternative characterizations of 
excitation in dynamical systems. While inequality l|41|) accounts for specific properties of the signals in 
the uncertainty, inequality (|44|l accounts for possibility to detect parametrical difference from the difference 
/(x(t),0i,t) — /(x(t), 02, t). Taking into account these two equally possible but still rather distinct char- 
acterizations of excitation in nonlinear systems, in Theorem [21 below we present a set of alternatives for 
parameter convergence in system QJ, qiUfl. ||53J, (l2*5|l . 
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Theorem 2 (Convergence) Let system (I)). ^1(J\) . k2°H\) . \2ty satisfy Assumptions^^ Let, in addition, 
Assumption^ hold with £>(x,i) = 0. Then x(i) £ L^fto, oo], 9{t) G _L^[to,oo]. Moreover the limiting 
relation: 

lim 9(x(t),t) = 9 

t — >oc 

is ensured if a(x, t) is locally bounded in x uniformly in t, and one of the following alternatives hold: 

1) function a(x(£),i) is persistently exciting, and hypothesis L^ holds; 

2) function f (x(i) , 9 , t) is nonlinearly persistently exciting, i. e. it satisfies condition \4$ '> it satisfies 
hypotheses L^\ L^j function ip{ip,ijj,t) satisfies L^; function dt/j(n,t)/dt be locally bounded in x uniformly 
in t; 

In case alternative 1) is satisfied, the estimates 9{n.{t),t) converge to 9 exponentially fast. If, in addition, 
a(x.(t),t) is uniformly persistently exciting and Assumption^ holds, then convergence is uniform. The rate 
of convergence can be estimated as follows: 

\\9(t)-O\\<e- pt \\9(to)-0\\D r (45) 

D r =[- -— , «oo= sup ||a(x,t)|| 



l|x||<l|x(*)ll=c,[t ,=°]> t>t 



' 2L(l + \l ax (T)L^D^ai o y VWn. 

Notice that TheoremElconsiders error models IjlOjl where no disturbance term e(t) is present. Despite this 
Theorem|2can be straightforwardly extended to error models with disturbance Indeed, as follows from 
alternative 1), the parameter estimation subsystem becomes exponentially stable in case function a(x(t),t) 
is (uniformly) persistently exciting. This in turn allows (sufficiently small) additive disturbances in the right- 
hand side of I|1U|) . In case the excitation is uniform, convergence of the estimates 9 (t) to a neighborhood of 
9 is guaranteed for every e(t) G L^^o, 00] by inverse Lyapunov stability theorems |27j . 

In case of alternative 2), nonlinear persistent excitation condition (|44|l guarantees convergence l|18|) with- 
out invoking Assumption 0] or In this case, however, the convergence may not be robust, which seems 
to be a natural tradeoff between generality of nonlinear parameterizations /(x, 9, t) and robustness with 
respect to unknown disturbances e(t). 

5 Discussion 

So far we have shown that, for the class of nonlinearly parameterized systems, there exist a control function 
and parameter adjustment algorithms, such that solutions of the whole system are bounded and parametric 
uncertainty is decreasing in time. We have shown also that in case of persistently excited functions a(x,t) 
the estimates 9(t) in ll'MI) converge exponentially fast to vector 9. These results, however, are not necessarily 
limited to functions satisfying Assumptions [3] or 0] Due to space limitations, however, we provide just the 
main ideas of possible extensions, leaving out the technical details. Let us first examine the case where these 
assumptions hold only in some domains of the system state space. 
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Figure 3: Domain for system (|46H with nonlinear parameterized function sin(0a;i), S fig 

Nonlinear functions satisfying Assumptions^^ in a domain o/R™. Let, in particular, for the given 
nonlinear function /(x, 9, t) there exits the following partition of the state space: 

3 

where fljjj are the subsets of W 1 where Assumptions|30]arc satisfied for every 6 € fig with the corresponding 
functions Oj(x, i) and constants Dj, Dij. Let us also assume that VLm contains an open set. 

A typical example of a nonlinear function which satisfies this assumption is sin(0x), where the unknown 
parameter 9 belongs to a bounded interval. Let, for instance, the system dynamics is given by 

±i =x 2 

x-2 = sin(fei) + u, 

where parameter E fig = [0.6, 1.4] is unknown a-priori. For the given bounds of fig the domain Qm can be 
derived as follows: 

fl M = {x | n e [-3.38, -2.59]} U {x | xi E [-1.14, 1.14]} U {x | Xl E [2.59, 3.38]} 

= Om,1 U Q,m,2 U Qm,3 

and the function ct(x, t), satisfying Assumptions [31 0] in flj^ is defined as 



(46) 



(47) 



a(x, t) 



xi, xefi M ,2 

—Xi x e Qma U Om,3 



Another example is x e , € [to , oo) . The last parametrization is widely used in modelling physical "power 
law" phenomena in nature (see, for example |67| . where this function models effects of nonlinear damping in 
muscles). 

The fact that Assumptions [31 0]hold in the domain Hm C M. n , allows us to guarantee decrease of the 
norm — 0(t)|| r _i only if the state belongs to fij^f. Therefore, extra control is needed in order to steer state 
x back into the domain flu- Let us, for example, pick point x* 6 Qmj such that distjx*, Qa} > r, r E R + . 
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Let, in addition, there exists control function uo(x.,t) such that it steers state x of system JJJ from the 
initial point Xo into the ^-neighborhood U(6o,x*) of x* in finite time Tb(xo). Suppose also that 5q < r. As 
follows from Theorems ^ 13 Q(f) is bounded for every segment of the solution which starts from U(So,x*) at 
t = ti and leaves the domain ?7(r,x*) at t — ij+i. Furthermore the bound for ||0||oo,[tj,t i+ i] can be estimated 
a-priory from the bounds on and ||e(t)||2,[t ,oo ( see also J2IJ0- Given that the right-hand side of system JTJ, 
©, (EH, HU) is locally bounded we can conclude that the time interval ti+i — ti will always be separated 
from zero. Taking into account the results of Theorem [2 equation (|45|) . we may conclude that sufficiently 
high excitation, defined by the ratio 5/L, will guarantee that ||0(tj + i) — 0\\ < K\\0(ti) — 0\\, eel, < k < 1. 
If the time sequence {ti} is infinite (i.e. the system always escapes the ball U(r, x*)) then convergence is 
asymptotic. In case the sequence {ti} is finite (i.e. 3 t* > : x.(t) G fljif Vi > t*) convergence is exponential, 
this follows from Theorem [3 

In principle, the size of Q,m and its location in M™ depend on the bounds of fig. In fact, the larger the 
bounds, the smaller the volume of f2jvf. Moreover, the size of Am as a function of the bounds of fig depends 
on specific properties of nonlinearity /(x, 8, t). These observations suggest that in order to handle a broader 
class of nonlinearities (or functions with higher degree of uncertainty in 9) within the strategy proposed 
above, one needs to increase the excitation in functions ct^x, t). This is consistent with previously reported 
results on parameter convergence in nonlinear ly parameterized systems. Whether the extension of the 
class of nonlinearities to more general functions renders it necessary to increase excitation, however, is still 
an open issue 14 . 

Functions /(x,0,£) with nonlinear incremental growth rates in 8. Another direction to extend the class 
nonlinear functions suitable for our method is to allow nonlinear bounds for the growth rates in l|14|l. (|16fl 
in Assumptions |3| El The most straightforward generalizations, which do not change dramatically the 
machinery of technical proofs of Theorems ^ 13 are provided in Assumptions [7| below: 

Assumption 6 For the given function /(x, 9, t) in $TTj) there exist function a(x, t) : R n xM + — > R d , ct(x, t) G 
C 1 , function a : M. d — > M. d , er(z) = (eri(zi), o^^), ■ ■ ■ , o~d{zd)) T 

and function 7 G /C such that 

(/(x, 0, t) - /(x, 0, i))a(x, t) T *{0 -0)>O (48) 



|/(x,d,t)-/(x,e,t)| <7(|a(x,<) T <r(0-0)|) (49) 

14 An example is given in 1101 . where nonlinear persistent excitation condition holds for the given parametrization, while 
linear persistent excitation condition for linear parametrization with respect to the same parameter-independent function is not 
satisfied. 
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Assumption 7 For the given function /(x, 0,i) in and function a(x, t) satisfying Assumption&there 
exists function 7 £ /C such that 

7(|a(x,i) T ,r(0-0)|) < |/(x,£M)-/M,*)l 

Choosing for simplicity T = I, denoting A/(0, 0,x, t) = |/(x, 0,t) — /(x, 9,t)\, letting \e(t)\ in (fTTJl be 
such that J °° 7 e (|£(r)|)dr < 00, j e £ K and replacing Vg(0,0, t) in ljo7)l (proof, of Theorem^ Appendix 1) 
with 

Ve(0,9,t)=J2 / 7e(|e(r)|)dT 

we can obtain the following estimate: 

V = -<r(0 - 0) T a(x, t)(/(x, 0, t) - /(x, 0, t)) + £ (t)<7(0 - 0) T a(x, t) - 7e (|e(t)|) 

< -7- x (A/(0, 0, x, i))A/(0, 0, x, t) + |e(i)|7 _1 (A/(0, 0, x, t)) - 7 e(|e(t)|) (50) 

Boundedness of follows from (|50|l if we can resolve the following inequality for unknown 7c (|e(f)|): 

-7- 1 (A/(0,0,x,t))A/(0,0,x,f) + ^^(AMe.x.t)) - 7e (|e(t)|) < 0, 

If in addition there exists 7/ € K, such that 

-7- 1 (A/(0,0,x,i))A/(0,0,x,t) + |e(t)|7- 1 (A/(0,0,x,i))- 7e (| £ (t)|) < - 7/ (|A/(0,0,x,t)|) (51) 

then we can guarantee that A/(0(i), 0, x(t), i) € L^, [t , 00], where L" [to,co] is the space of all functions 
f (f) : R+ -> R" with finite integral J °° 7 /(||f (t)||)df < 00. Therefore, if system (H2J has L*[i 0) 00] UZ* e h-> 
gain, we can conclude, invoking this new modified Assumption [21 that i/j(x(t),t) e L^, x(i) G LJ^. 
Notice that letting functions 7, 7 linear ( 7 (|s|) = Z?|s|, 7 (|s|) = -Di|s|), allows us straightforwardly obtain, 
as in i|tj9|) . that choice j t — e 2 ensures the following inequality: 

V < ~ (\f(x,6,t) - /(x,0,t)| - ^(t)) 

This implies that properties similar to Pl)-P7) can be derived for the case where Assumptions [3J 0] arc 
replaced with Assumptions® Eland functions 7 (-), 7 (-) are linear (for the proofs of Theorem^ and Corollaries 
m2]see the Appendix). Parameter convergence in this case can also be deduced from Theorem[21 alternative 
2). Notice that, due to the nonlincarities in er(0 — 0), convergence in general may not be exponentially fast. 

For the nonlinear functions 7, 7 in Assumptions El the formulation of the results will require the 
notions of L 7 , spaces introduced above. The machinery behind the statements, however, will remain the 
same. The practical relevance of these results with nonlinear functions 7, 7 is that they enable us to take 
into account the specific properties of the signal s(t) when designing control, adaptation and parameter 
estimation procedures. If, for example, disturbance e(t) is due to observers, we might derive requirements 
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on convergence rates for the observer-induced errors e(t) (i. e. e(t) e [to, oo], and 7 e (-) satisfies inequality 
(JSJl). Given these rates and the fact that A/(x(i), 9(t), t) 6 Ll (f [to, oo], the target dynamics 

i, = -<p(tp, w, *) + C(t), C(*) e L*, [to, oo] U [t , oo] 

should be chosen in order to guarantee boundedness of ij){t) for all ((t) 6 [i , oo] U [to, oo]. This will 
allow synergy at all stages of the design and analysis of adapting systems. 

Singularities in control Jfy) . and non-affine models. In the problem statement we restricted the class of 
nonlinear systems of interest models that arc affine in control and furthermore, we assumed that inverse 
(L g ( x )?/>(x, t)) 1 exists everywhere. Even though this restriction holds in wide variety of practically relevant 
situations, the question is whether the proposed approach could be extended to more general classes of 
systems. Let us, for instance, assume that either L g ( x )?/>(x, t) — for some x 6 R™, or the right-hand side 
of Q} is not affine in control, e.g. 

x = f(x,0,u) (52) 

Obviously, control function @, which transforms into (|1U|) . is not relevant any more. Despite that, it is 
still possible to transform system Q into an error model, similar to (|10|l . In order realize this transformation 
without invoking the use of linearity in the control or taking inverse (L g ( x )^(x, t)) , it should be possible 
to find a function w(x, 9, oj, t) such that the following invariance condition is satisfied: 

— — — f (x, 9, u(x, 9, u>, t)) = -ip(i/j(x, t), u, t) — — (53) 

Denoting 

(x, 0, u(x, G, u>, t)) = -/*(x, 9, 6, w, t) (54) 
and taking into account (|52|) . i|53|) . and (|54|) we can calculate derivative ip in the following form 

i, = -r(x,fl 1 fl ) « ) i) +r(x ) 8,fl |U| t) - nx.fl.fl.w.t) + M 

= - V (V»(x,t),a;,t) + r(x,e,fl,a;,t)-/*(x,fl,e,a»,t) (55) 

The main difference between error models l)55|) and (|10|l is that function f*(x,9,9,u>,t) in (|55|l depends 
on additional parameters 9, ui. Despite this difference our approach can still be applied to models (15511 
if inequalities l|14|) . (|16|l in Assumption [3] (or/and hold for function f*(x,9,9,u,t) for any u> G 
Adaptation algorithms in this case can straightforwardly be derived from 1)64(1 . (|65J) (in Appendix 1) and 
will have the form similar to (|23)l . (|25)l . 

In the next section we illustrate the application to and main steps in the design of our algorithms for the 
optimal slip identification problem in brake control systems. 
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6 Example 

Consider the problem of minimizing the braking distance for a single wheel rolling along a surface. The 
surface properties can vary depending on the current position of the wheel. The wheel dynamics can be 
given by the following system of differential equations |51j : 

xi = -—F s (F n ,x,6), 
m 

±2 = j{F s (F n ,x,8)r-u) 

is = - — ((-(l-X3) + ^j)F s (F n ,x,e)-^u), (56) 
x\ m J J 

x\ is longitudinal velocity, xi is angular velocity x 3 = {x\ — rx-ij/xx 15 is wheel slip, x = {x\ 1 X2,x 3 ) T , 
m is mass of the wheel, J is moment of inertia, r is radius of the wheel, u is control input (brake torque), 
F s (F n , x, 9) is a function specifying the tyre-road friction force depending on the surface-dependent parameter 
9 and the load force F n . This function, for example, can be derived from steady-state behavior of the LuGrc 
tyre-road friction model [H] : 

^g(x2,x 3 ,9)j^- 

g(x 2 , x 3 , 0) = 6(nc + (MS - Mc)e" i™-"""- ), (58) 

where [ic-, Ms are Coulomb and static friction coefficients, v s is the Stribeck velocity <tq is the normalized 
rubber longitudinal stiffness, L is the length of the road contact patch. In order to avoid singularities we 
assume, as suggested in |51|. that the system is turned off when velocity X\ reaches a small neighborhood 
of zero (in our example we stopped simulations as soon as x\ becomes less than 5 m/sec). Moreover, given 
that functions l|57|l. (|58|l are bounded for the relevant set of the system parameters, it is always possible to 
design control function u(x, t) in l|56|l such that 

x 3 {t) €[5,1-5], 5€R, 5>0 (59) 

for all t : Xi(t) > 5i, 5i = 5 m/sec. 

While the majority of the model parameters can be estimated a-priori, the tyre-road parameter 9 is 
dependent on the properties of the road surface. Therefore, on-line identification of the parameter 9 is 
desirable in order to compute the optimal slip value 

xt = argmax-F s (-F n ,x, 9) (60) 

which ensures the maximum deceleration force and therefore results in the shortest braking distance. 



3 Given this functional relation, variable £3 in 1561 can be viewed as an output of the reduced system with state (x\,X2). 
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The main loop controller is derived in accordance with the standard certainty-equivalence principle and 
can be written as follows: 



u(x,§,x* 3 ) = j((^(l-x 3 )+'-j)F a {F n ,x,0)-K aXl (x 3 -xt)), K s > 



In order to estimate parameter 9 by measuring the values of variables x%,X2 and X3, we construct the 
following subsystem: 

k = - — ((—(l-ara) + r -f)F s (F ni x,9) - -u) + (a 3 - as) 
x\ m J J 

and consider the dynamics of error function ip(x,t) = il){x3,X3) = X3 — £3: 

^ = -4> + — (-(1 - 13) + ^)(F s (F„,x, 9) - F s (F„,x, §)) (61) 
X\ m J 

The desired dynamics of system Ijfilj l is 

^=-V + £(t) (62) 

where £(t) is to be from Lg^OjOo]. Let us check Assumptions ^ d f° r the function ip(pc,t) — X3 — xa(t) and 
system (|62H . Notice first that state x of system (|56H is bounded according to the physical laws governing 
the dynamics of (|56|l . In addition, boundedness of ^(x, t) implies that £3(4) is bounded. Hence Assumption 
^holds. System (|62[) . obviously, has L^iojOo] 1— > Loo[to,oo] gain. We can conclude that Assumption [21 also 
holds. Let us check Assumptions |21 El 

Taking into account (|59|l we can conclude that function jr(;^(l — £3) + ^j) in l|61|) is positive and, 
furthermore, is separated from zero for all X \ > b\. Therefore, taking this into account equations JS7J), (|58|l 
we can conclude that function ^-(^(1 — £3) + L j-)F s (F n ,x,9) in l|tjl|) satisfies Assumptions |3 01 with 

a(x, t) = const = 1, V Xi : 8% < x\ < xi(to) 

Therefore, in order to design an estimation scheme satisfying assumptions of Theorem |21 we shall find 
functions ^(x, t), B(x,t) such that Assumption [5] holds. It is easy to see that this assumption is satisfied 
with ^'(x, t) = const, and B(x, t)=0. Let us choose, therefore, ^(x, t) = 0. Then according to l)23|) and 
a parameter adjustment algorithm will be given by the following system: 

= 7{{x 3 - x 3 ) + 9 T ), §! = (x 3 - £3), 7 = 100 (63) 

An important fact about algorithm l|t)3|) is that it is a parametric linear proportional-integral scheme. Ac- 
cording to Theorem|21the estimates (|63|) converge to 9 exponentially fast in the domain specified by equation 
(|59|l . and inequality Xi{to) > x\(t) > S±. The last inequality is satisfied as, according to l|5t)l) . time-derivative 
of the variable Xi(t) is non-positive and the system is turned "off" when x\{t) < 8%. 

We simulated system (I56|l - (|63|) with the following setup of parameters and initial conditions: 00 = 200, 
L = 0.25, nc = 0.5, [i s = 0.9, v s = 12.5, r = 0.3, m = 200, J = 0.23, F n = 3000, K s = 30. The effectiveness 
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Figure 4: Plots of the trajectories of system (|56|l 

of estimation algorithm (|63|l could be illustrated with Figure 4. Estimates 9 approach the actual values of 
parameter 9 sufficiently fast for the controller to calculate the optimal slip value x% and steer the system 
toward this point in real braking time. Effectiveness of the proposed identification-based control can be 
confirmed by comparing the braking distance in the system with on-line estimation of x^ according to 
formula l|60|) with the one, in which the values of x% were kept constant (in the interval [0.1, 0.2]). For model 
parameters as presently given and road condition given by the piece-wise constant function 



t 

Xi(r)dr 

o 



the simulated braking distance obtained with our on-line estimation procedure of x% is 54.95 meters. This 
result compares favorably with the values obtained for preset values of x$, which range between 57.52 and 
55.32 (for x% = 0.1 and x% — 0.2 respectively). 

7 Conclusion 

In the present article we provided new tool for the design and analysis of adaptive/parameter estimation 
schemes for dynamic systems with possible Lyapunov-unstable desired dynamics and nonlinear parameteri- 
zation. In our method we consider adaptation as a process of asymptotic compensation of the uncertainty, or 
as control in functional spaces, rather than as simply reaching of a control goal. In particular, we wished to 
achieve that mismatches between the modeled uncertainty and compensator vanish asymptotically with time 
or belong to specific functional spaces. This understanding of adaptation naturally leads to the possibility 
to describe the desired dynamics of adapting systems in terms of an operator, which maps these mismatches 
into error functions, as functions of time from a functional space. Continuity of this target operator is not 
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required. Hence stability of the desired dynamics, as a substitute of continuity, is not necessary for our 
approach. The adaptation mechanism itself could be viewed as control in functional spaces. In the other 
words, the aim of adaptation consists in ensuring that the uncertainty-induced errors of the compensator 
belong to a specific functional space. This idea leads to classes of adaptive systems, where applications 
require gentle, non-dominating control and where the desired dynamical state can be unstable. 

When the desired motions in the system are known to be Lyapunov stable, our approach allows to design 
adaptation procedures without knowledge of the particular Lyapunov function. As mentioned in |4U) . this 
was one of the open theoretical challenges in the theory of adaptive cotnrol. 

Another contribution of our present study is that we proposed a new class of parameterizations for 
nonlinearly parameterized models. Instead of aiming at a general solution for the problem of nonlinearity 
in the parameters, parametrization was restricted to a set of smooth functions, which are monotonic with 
respect to a linear functional in the parameters. For this new class, adaptation/estimation algorithms were 
introduced and analyzed. It was shown that standard linear persistent excitation conditions suffice to ensure 
exponentially fast convergence of the estimates to the actual values of unknown parameters. If, however, 
the monotonicity assumption holds only locally in the system state space, excitation with sufficiently high- 
frequency of oscillations still is able to ensure cpnvergence. In addition to the analysis of the effects of 
conventional persistent excitation on convergence, we also formulated a much weaker property - nonlinear 
persistent excitation condition. With this new property we established conditions for asymptotic convergence 
of the estimates. It is also desirable to notice that in case of linear parametrization the proposed parameter 
estimation schemes allow to estimate the unknowns in a dynamical system without asking for the usual 
filtered transformations, thus reducing the number of integrators in the estimator. 

An application of our results, which is relevant to the parameter estimation problems for systems with 
nonlinear parameterization, was provided as an example. In this example wc did not cover all solutions 
to every theoretical problem we were targeting in this article. In particular, it covers only the problem of 
nonlinear parameterization. The main rationale, however, was to illustrate all steps of our method. Last but 
not the least, the application presents a practically relevant solution to an important engineering problem. 
The effectiveness of the solution to this problem leads us to expect that our newly proposed method can 
successfully be implemented in a variety of other applications. 

8 Appendix 1. Proofs of the theorems and auxiliary results 

Proof of Theorem^ Let us first show that property PI) holds. Consider solutions of system (QJ, (fill) . 1|23|) . 
(|25|1 passing through the point x(to), 6i(to) for t G [to,T*] 16 . Let us calculate formally the time-derivative 

16 According to the theorem formulation, interval [to,T*] is the interval of existence of the solutions 
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of function 0(x, t): 0(x, t) =T{9 P + 7 ) = r(^a(x, t) + ipa(x, t) - *(x, i) + 7 ). Notice that 

, . , \ t / \ j. , . „ dattx. t) . , , , da fx) . , , . 9a(x, i) 

V-a x, t) - * x, t) + 7 = ^ x, f) v ' ; Xl + i> x, 0^7^X2 + V x, t ^ - 

axi 0x9 at 

^ Xl _^ Xj _^ + i,, (64) 
axi ox 2 at 

According to Assumption \5\ ^g^^ = ^( x > ^) 3 fe'^ + S(x, £)■ Then taking into account (|64|) . we can obtain 

, ./ n -f/ x j> /\, ,aa(x,t) <9*\ . , . ,dot(x,t) *(x,t) 
<M(x, t ) - *(x, t ) + 7 = ^(x, t) VXx, t) -^1 - - 

B(x,i)(f 2 (x,0)+g 2 (x) U ) + 7 (65) 

Notice that according to the proposed notation we can rewrite the term (ip{x, t) d °^f^ — x i m the 
following form: (^(x, t)if 1 a(x, t) — Zf^fx, t)) + (V>(x, f)L gl a(x, t) — L Sl ^(x,t))u(x,8,t). Hence it follows 
from J23J) and ffijft that i(;a(x,t) ~ #(x,i) + 7 = p(V>)a(x,t) - S(x,t)(f 2 (x, 0) - f 2 (x,0)). Therefore 
derivative 0(x, i) can be written in the following way: 

= r((V> + ^))a(x, i) - B(x, t)(f 2 (x, 0) - f 2 (x, 0))) (66) 

Consider the following positive-definite function: 

^(0 ) 0,t) = -||0-0||2_ 1+ _jf e 2 (r)dr (67) 



Its time-derivative according to equations l|66|l can be obtained as follows: 

V 6 (0, 0, t) = {tpW + V>)(0 - 0) T a(x, t)-(0- 9) T B{x, i)(f 2 (x, 0) - f 2 (x, 0)) - ^s 2 ( i 1 ( (,s ) 



Let B(x,i) ^ 0, then consider the following difference f 2 (x, 0) — f 2 (x, 0). Applying Hadamard's lemma we 
represent this difference in the following way: 

f 2 (x,0)-f 2 (x,0)= / d f2(x ' s(A)) rfA(0-0), S (A) = 0A + 0(1 - A) 
Jo os 

Therefore, according to Assumption [S] function (0 — 6) T B(x, f)(f 2 (x, 0) — f 2 (x, 0)) is positive semi-definite, 
hence using Assumptions 03 H and equality lfTT|l we can estimate derivative Vq as follows: 

V 6 (0, 0, t) < -(/(x, 0, t) - f(x, 0, t) + s(t))(6 - 0) T a(x, t) - -^e 2 (t) 

< -i(/(x, 0, i) - /(x, 0, i)) 2 + i-| £ (<)||/(x, 0, t) - f(x, 6,t)\- ^e 2 (t) (69) 

< ~ (\f(x, 0, t) - f(x, 0, t)| - < 



It follows immediately from l|69|l . (|67|l that 



D 



\6{t) - 0\\U < \\6(t ) - 9\\U + ^ \\e(t)\\i, [*„,«,] (70) 
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In particular, for t G [to,T*] we can derive from (|67J) that 



\e(t)-e\\U < \\9(t o )-0\\U 



D 
2Df 



\e(t)\\ 



2,[t ,T*] 



Therefore 0{t) G L^[t ,T*]. Furthermore |/(x(i), 0(t), t) - /(x(t), 0, t)\ - ^e[t) G L\[t ,T*]. In particular 



\f(x(t),0(t),t)-f(x(t),0,t)\ 



D 
2D[ 



e(t) 



<y 110-0(^11^ + ^11^)111 

2,[t ,T*] L 



tn,T* 



(71) 



Hence /(x(i), 0{t), £) — /(x(t), 0, t) G L\[tQ,T*] as a sum of two functions from L^to, T*]. In order to estimate 
the upper bound of norm \\ f (x(t) , (t) , t) — /(x(t), 0, f)||2,rt D ,T*l from i|71|) we use the Minkowski inequality: 



/(x(t),0(f),t)-/(x(t),0,i)l 



21^ 



e(t) 



2,[t„,T* 



: (f [[ff-»(*o)llr-x 



0.5 



2D[ 



\Ht)h,{to,T*] 



and then apply the triangle inequality to the functions from L\[tQ,T*] 



||/(x(i),0(i),f)-/(x(t),M)lk[t o> T.] < 



D 



\Wt)\ 



2Di "~^^" 2 ^o^i ~ \ 2 
Therefore, property PI) is proven. 

Let us prove property P2). In order to do this we have to check first if the solutions of the closed 
loop system are defined for all t G R+, i.e. they do not reach infinity in finite time. We prove this by a 
contradiction argument. Indeed, let there exists time instant t s such that ||x(t s )|| = oo. It follows from 
PI), however, that /(x(i), 0(t), t) — /(x(i),0,i) G L^Ojts]- Furthermore, according to (|72Jl the norm 
||/(x(i),0(i),£) — /(x(t), 0, t)|| 2 jt ,t s ] can be bounded from above by a continuous function of 0, 0(to), T, 
and ||e(t)||2,[t ,oo]- Let us denote this bound by symbol Df. Notice that Df does not depend on t s . Consider 
system lfTH for t G [tojts]: 

ijj = /(x, 0, t) - /(x, 0, t) - tpty, u, t) + e(t) 

Given that both /(x(t),0,t) — f(x(t),0(t),t),e(t) G L\[to,t s \ and taking into account Assumption [3 we 
automatically obtain that , 0(x(t), t) G L^io, t s ]. In particular, using the triangle inequality and the fact 
that function 7^2 ("0(xo, to): M) in Assumption [21 is non-decreasing in M, we can estimate the norm 
||V'(x(t),t)|| OOi[t0 , ts ] as follows: 

||lK*(*)>*)IU[to,t.] < 7oo.2 (il>{xa,to),o>,Dt + ||e(t)||i i[t0iOo] ) (73) 
According to Assumption ^ the following inequality holds: 



D , 



6> - ^(io)Hr-i 



/(x(t),0(t),t)-/(x(t),M) 
0.5 



D 
2Ih 



2,[t ,T*] 



D 
~D~i 



(72) 



l|e(*)l|2,[to,T.] 



||x(t)]]oo,[t D ,t s ] < 7 ( x O,0,7oo,2 xq, to)i <*>, D/ + ||£(t)|| 2 ,[t , 



(74) 



Given that a superposition of locally bounded functions is locally bounded, we can conclude that ||x(t)|| oo [ t0 ts j 
is bounded. This, however, contradicts to the previous claim that ||x(t s )|| = 00. Taking into account 
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inequality (|70J) we can derive that both 9(x(t),t) and 9i(t) are bounded for every t £ R+. Moreover, 
according to (|74|l . I|7U|I these bounds are (locally bounded) functions of initial conditions and parameters. 
Therefore, x(t) £ L!^[io,oo], 0(x(i),i) £ L^[i ,oo]. Inequality J23 follows immediately from JEl, Hi, 
and the triangle inequality. Property P2) is proven. 

Let us show that P3) holds. It is assumed that system l|12[l has L^to, oo] i— > Lp[io,oo], p > 1 gain. 
In addition, we have just shown that f(x(t),9,t) — f(x(t),9(t),t),e(t) £ i^Iio, 00 ]- Hence, taking into 
account equation (|llfl we conclude that ^>(x(t),i) £ Lp[<o,oo], p > 1. On the other hand, given that 
/(x, 0,i), ip(ip,u),t) are locally bounded with respect to their first two arguments uniformly in t, and that 
x(i) 6 J&Ito.ool.V'Wt),*) e L ~[*o,oo], *(*) G J&[t ,oo], G n e , signal </#(x(t), *), w, t) + /(x(t), 0, t) - 
f(x(t),d(t),t) is bounded. Then e(f) g L^^OjCxd] implies that ip is bounded, and P3) is guaranteed by 
Barbalat's lemma. 

To complete the proof of the theorem (property P4) consider the time-derivative of function /(x, 9. t): 
— /(x, 0, t) = if (x , ) + g (x )„ (x ,g )t )/(x, <?, t) + ^ w, t) + i/f)a(x, t) + ^ 

Taking into account that f(x, 0), g(x), function f(x,9,t) is continuously differentiable in x, 9; derivative 
df(x,9,t)/dt is locally bounded with respect to x, 9 uniformly in t; functions a(x, t), dip(x.,i)/dt are 
locally bounded with respect to x uniformly in t, then d/dt(f(x,0,t) — /(x, (?,£)) is bounded. Then given 
that f(x.(i),9,i) — f(x(t), 0(t), t) £ £3,^0, °°] a PPly m S Barbalat's lemma we conclude that /(x, 0,r) — 
/(x, 0, r) — > as t — » oo. T7ie theorem is proven. 

Proof of Corollary ^\ Let e(t) = 0. Then choosing the function Vg/ e g t > as in 1)67(1 . using l|68|). and 
invoking Assumption we obtain that 

^(d,fl, t ) ^ -(/( x > e ' *) - Z( x ' *))»( x > *) T (* - ^ -i^( x ' ' f ) - ^ x - *)) 2 ( 75 ) 

Equality (|75|) and the fact that e(t) = in i|67|) imply that the norm \\9 — 0||p_i is non-increasing. Further- 
more, l(75|) implies that 

||/(x(t),e,*)-/(x(t),e(t),t)|| 3 , [t0 , r . ] < (§||d(to)-e||^) ( 76 ) 

This proves property PI). Taking into account (|76|l and given that Assumptions ^ El arc satisfied we can 
conclude that x(t) £ L£,[to,oo], ip(x.(t),t) £ £^[£9,00], and the following estimate holds: 

ll^(x(*),t)|| 

OO, [to )°°] 

Hence P2) is also proven. Properties P3),P4) follow by the same arguments as in the proof of Theorem 
Therefore, P5) is proven. The corollary is proven. 

Proof of Corollary^ Let us show that P6) holds. Without the loss of generality assume that solutions 
of the system exist over the following time interval [to,? 1 *]. According to Theorem ^ property PI), the 
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norm \\9 — 6(t)\\ is bounded from above by a function of initial conditions 0(to), parameters T, D, D±, and 
Il £ (*)ll2,[to,ool- Let us denote this bound by symbol Bg. Notice that Bg does not depend on T* . On the other 
hand, according to Hypothesis tCHthe following estimate holds: 

3D g >0: |/(x, 0, t) - /(x, e.t)\<Dg\\e-e\\ 

Hence |/(x(t),0,i) - /(x(i), d(t),t)\ G L^[t ,T*] and moreover 

\\f(x(t),0,t)-fted(t)M°°,[t o ,T']<DeBe (78) 

Consider the following signal fi(t) = /(x(t),0,t)-/(x(t),0(t),t)+e(i). Signal ^(t) 6 L^[i , T*] nL^[t , T*], 
and let Moo, M 2 G M + be the bounds for its L^JtojT*], L^Ch? 1 *] norms respectively. According to 

/ „ \0.S 

(|75|l . these bounds can be estimated as follows: Moo = DgBg + ||e(t)||oo,[t ,oo]) M% = ( — \\0 — 0(to)|| 2 -i ) + 
^j^- + 1^ ||e(0ll2,[to.oo]- Therefore, given p > 2 one can derive that 

y* oo />oo 

/ ^(r)dr = ^- 2 (r)/x 2 (r)dT < M£T 2 M| 

Hence, G L^o,? 1 *] and its L p [to, T*]-norm is bounded from above by M^ _2 M|, where the bounds 
Mqo, M2 both do not depend on T*. According to the corollary formulation, system (|12|l has Lp[to,oo] — > 
L^JiojCX)] gain and therefore ip(x(t),t) G Loo[to,T*]. Then applying the same argument as in the proof 
of property P2) of Theorem ^ and using Assumption ^ we can immediately obtain that x(f) G L^[io,co], 
^/>(x(i), i) G L^fto, 00], and 0(t) G L^ftg, 00]. Thus property P6) is proven. Property P7) can now be proven 
in the same way as property P3) in Theorem ^ The corollary is proven. 

Proof of Theorem^ According to the theorem formulation, Assumptions 11121 01 151 hold. Hence, applying 
Corollary^we can conclude that 0(t) G L^to, 00] and x(t) G L^to, 00]. 

Let us show that limiting relation (|18|l holds in case alternative 1) is satisfied. To this purpose consider 
derivative 0: 

b = r(v> + ¥»(V))a(x, t) = r(/(x, 0, t) - /(x, 0, <))«(x, t). (79) 

Given that (t) G L^JiojOo] and x(t) G L^^o, oo], and that Hypothesis EQ] holds, the function f(x,0,t) 
satisfies the following inequality for some D, D\, G K+: 

^!|a(x,t) T (0-0)| < \f(x,0,t) - f( X ,0,t))\ < D\a(x,t) T (0 - 0)\; 
a(x, i) T (0 - 0)(/(x, 0, i) - /(x, 0, t)) > 

Therefore, there exists function k : M + — » M + , Z?! < K 2 (i) < I? such that 

= -K 2 (f)fa(x, i) T (0 - 0)a(x, t) = -K 2 (t)Ta{x, t)a(x, i) T (0 - 0) (80) 
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Notice that matrix T is a positive definite and symmetric matrix. It, therefore, can be factorized as follows 
r = ToT^: where Lo is nonsingular nxn real matrix. Let us define 9 = Tq 1 {9 — 9). In these new coordinates, 
equation l|8()(l will have the following form: 

e = -K(i) 2 r t 7 1 r rjQ;(x, *)a(x, t) T (o -o) = -K 2 (t)r^a(x, t)a(x, t) T r e (8i) 

Denoting n(t)TQ a(x, t) = </>(x, t) we can rewrite equation lf£T|l as follows: 

9 = -4>(x,t)ct>(x,t) T d (82) 
where function </>(x, t) : M. n x R + — > R d satisfies equality: 

/ rt+L \ 

»7 T y < /»(x(r),r) < /,(x(r),T)dT J7 = r, T rn y « 2 (r)a(x(r), r)a(x(r), r) T dr J r r7 (83) 

for all rj € M. d . Taking into account that function a(x(f),£) is persistently exciting, T = TqTq, and that 
K 2 (t) > D\ we can obtain the following bound for quadratic form JH3J): 

rt+L 

r7 T y ct>{K{T),T)ct>{K{T),T)dTri > 5D 1 ||r f||| 2 = SD^Tri > ^iA min (r)||»7|| 2 = ^||r/|| 2 (84) 

Hence, function </>(x(i),i) is also persistently exciting. Notice also that ||0(x, t)\\ is bounded from above: 
||0(x,i)|| = [[/c(t)a(x,*)r || < A max (r )|| K (t)a(x,t)|| < A^^o)^^ 
aoo = sup ||a(x,i)|| 

l|x||<||x(t)||oo,[ t0 ,oo], t>t 

In order to show that lim^oo 9(t) — exponentially fast we invoke the following useful lemma from |36| 
(Lemma 5, page 18): 

Lemma 1 Let system be given, condition j#^| ) holds (uniformly), and </>(x, t) in \8ty) be bounded 

||(0(x, t))\\ < 4>m- Then system is (uniformly) exponentially stable and, furthermore: 



\~d(t)\\<e- Kt \\d(t )l K= V2 

M 1 + L( Pm) 



According to Lemma ^ solutions of system (|82[) converge to the origin exponentially fast with a rate of 
convergence defined by (JHEJ), where 

64, = A min (r)£>i<J, 4>li = A max (r) J D 2 a 2 c (86) 

Taking into account equation (jEEJ), (JEEJl and observing that (1 + L4> 2 M ) 2 < 2(1 + 0^L 2 ), A max (r ) 2 = A max (r) 
we can estimate |0(i)|| as follows: 

Given that ||r o 0(i)|| = \\(9(t) - 0)\\, and using we derive the following bounds for ||(0(t) - 0)||: 
\\(0(t)-8)\\ < \\T \\fd(t)\\ <KU^)e- K ^\\T^(9(t a )~9)\\ < ( Amax( ^ o) ) e~ K ^ ||0(t o ) - 0|| 

\ A m in (,1 j / 
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This proves alternative 1) of the theorem. 

Let us prove alternative 2). It follows immediately from Corollary^of Theorem [I] that 

lim /(x(t),M)-/(x(t),fl(i),i)=0 

t — >oo 

Furthermore, given that — T(f(x.(i),9,i) — f(x(t),6(t),t))a(x,t), x(£) G L^[io,oo] and a(x, i) is locally 
bounded in x uniformly in £, we can conclude that — > as i — > oo. Let us divide the R + into the following 
union of subintervals: 



= (J Ai, A t = fo, U + T], t = 0, t i+ i = U + T, ieN 



The fact that — > as t — > oo ensures that 

lim ||d(«i) - e(Ti)|| = 0, V r, G A j; (89) 

i—*-oo 

In order to show this let us integrate equation (|79fl 

||0( Si ) - 0(^)11 - ||F [ T ' (/(x(r), 0, r) - /(x(r), fl(r), r))a(x(r), r)dr|| (90) 



Applying the Cauchy-Schwartz inequality to (|90|) and subsequently using the mean value theorem we can 
obtain the following estimate: 

WHsi) -0(^)11 < ^ S+T ||r|| • |/(x(t),0,t) -/(x(r),e(r),r)| • ||a(x(r), r)\\dr 

= ||r||.T.|/(x(^),fl,^)-/(x(^),fl(^),^)|-Hx(^),^)||, r; £ A, (91) 

Given that limiting relation l|88|) holds, x(i) G i^[to,co], and a(x, £) is locally bounded uniformly in t we 
can conclude from (|91|l that limiting relation (|89|) holds. 

Let us choose a sequence of points from K.+ : {ri}<*L 1 such that r, G Aj, ieN. As follows from the 
nonlinear persistent excitation condition (inequality (|44H ) . for every 6(ji), Ti G Aj there exists a point 
£ ■ G Aj such that the following inequality holds 

||/(x(i0, 0, t[) /(x$), 0(ri), OH > ff(||0 - 0(^)11) > (92) 
Let us consider the following differences: 

/(x(i& dte), O - /(x(*a 0(4), tj), ri, 4 e a, 

It follows immediately from and (|89|l that 

lim /(x(tj),fl(r i ),t5)-/(x(tj) j fl(tj),0 =0, n,^ G A, (93) 
Taking into account (|93|) and l|88fl we can derive that 

lim /(x(^), 0, O - /(x(^), 0(r 4 ), tj) = lim (/(x«), 0, tj) - /(x(^), 0(^), tj)) + 

I — » OO 2 — >00 

lim /(x(ij), 0(4), fO - /(x(*0, 0(ri), *5) = (94) 
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According to (|94|1 and l|92|) . sequence {g(||0 — 0(^)11)}°^ is bounded from above and below by two sequences 
converging to zero. Hence, lim^oo g(\\6 — 9(ri)\\) = 0. Notice that g(-) G /C H C° which implies that 

lim \\9 - 6{n)\\ = (95) 

i — >oo 

In order to show that lim^oo^ — 9{t)) = notice that 

< \\e-e( Si )\\, Si = argmax||6>-0(s)|| VteA s 

Hence, applying the triangle inequality \\8 — 9(si)\\ < \\9 — 9(ri)\\ + \\6(Ti) — 0(si)\\ and using equations 1|89|) . 
(|95|l we can conclude that \\9 — 9(t)\\ is bounded from above and below by two functions converging to zero. 
Hence, \\9 — 9(t)\\ — > as t — > oo and limiting relation l|18|) holds. The theorem is proven. 

References 

[1] F. T. Arecchi, R. Meucci, G. Puccioni, and J. Tredicce. Experimental evidence of subharmonic bifur- 
cations, multistability, and turbulence in a q-switched gas laser. Phys. Rev. Lett., 49(17):1217-1220, 
1982. 

[2] B. Armstrong-Helouvry. Stick silp and control in low-speed motion. IEEE Trans, on Automatic Control, 
38(10):1483-1496, 1993. 

[3] A. Astolfi and R. Ortega. Immension and invariance: A new tool for stabilization and adaptive control 
of nonlinear systems. IEEE Trans, on Automatic Control, 48(4): 590-605, 2003. 

[4] Er-Wei Bai. Frequency domain identification of hammerstein models. IEEE Trans, on Automatic 
Control, 48(4): 530-542, 2003. 

[5] G. Bastin, R.R. Bitmead, G. Campion, and M. Gevers. Identification of linearly overparametrized 
nonlinear systems. IEEE Trans, on Automatic Control, 37(7):1073-1078, 1992. 

[6] J.D. Boskovic. Stable adaptive control of a class of first-order nonlinearly parameterized plants. IEEE 
Trans, on Automatic Control, 40(2):347-350, 1995. 

[7] M. J. Box, D. Davies, and W.H. Swann. Non-linear Optimization Techniques. Oliver and Boyd, 1969. 

[8] S. Camalet, T. Duke, F. Julicher, and J. Prost. Auditory sensitivity provided by self-tuned critical 
oscillations of hair cells. Proceedings of National Academy of Science, 97(7):3183-3188, 2000. 

[9] C Canudas de Wit and P. Tsiotras. Dynamic tire models for vehicle traction control. In Proceedings of 
the 38th IEEE Control and Decision Conference. 1999. 

[10] C. Cao, A.M. Annaswamy, and A. Kojic. Parameter convergence in nonlinearly parametrized systems. 
IEEE Trans, on Automatic Control, 48(3):397-411, 2003. 

36 



Ill S. Chantranuwathana and H. Peng. Adaptive robust control for active suspensions. In In Proc. of the 
American Control Conference, pages 1702-1706. 1999. 

121 V.N. Chizhevsky. Coexisting attractors in a CO2 laser with modulated losses. J. Opt. B: Quantum 
Semiclassical Opt., 2:711-717, 2000. 

131 P- Dayan and L.F. Abbott. Theoretical Neuroscience: Computational and Mathematical Modeling of 
Neural Systems. MIT Press, 2001. 

141 R- W. Ditchburn and Ginzburg B. L. Vision with a stabilized retinal image. Nature, 170(4314):36-37, 
1952. 

151 M. Enqvist and L. Ljung. Estimating nonlinear systems in a neighborhood of LTI-approximants. In In 
Proc. of the 41st IEEE Conference on Decision and Control, pages 1005-1010. 2002. 

161 P- Eykhoff. System Identification. Parameter and State Estimation. Univ. of Techn. Eindhoven, 1975. 

171 V. Fomin, A. Fradkov, and V. Yakubovich. Adaptive Control of Dynamical Systems. Nauka, 1981. 

18] A. L. Fradkov. Speed-gradient scheme and its applications in adaptive control. Automation and Remote 
Control, 40(9):1333-1342, 1979. 

19] A. L. Fradkov. Integra-differentiating velocity gradient algorithms. Sov. Phys. Dokl., 31(2):97-98, 1986. 

201 A. Garulli, L. Giarre, and G. Zappa. Identification of approximated hammerstein models in a worst-case 
setting. IEEE Trans, on Automatic Control, 47(12) :2046-2050, 2002. 

211 D. J. Gauthicr and J. C. Bienfang. Intermittent loss of synchronization in coupled chaotic oscillators: 
Toward a new criterion for high-quality synchronization. Phys. Rev. Lett., 77:1751-1754, 1996. 

22] E. Hansen. Global Optimization Uzing Interval Analysis. Marcel Dekker, 1992. 

231 J-L. Hindmarsh and R.M. Rose. A model of neuronal bursting using 3 coupled 1st order differential- 
equations. Proc. R. Soc. Lond., B 221(1222):87 102, 1984. 

241 A. Isidori. Nonlinear control systems I (3d edition). Springer- Verlag, second edition, 1996. 

251 A. Isidori. Nonlinear control systems II. Springer- Verlag, second edition, 1999. 

26] T.A. Johansen and B.A. Foss. Identification of non-linear system structure and parameters using regime 
decomposition. Automatica, 31(2):321-326, 1995. 

[27] H. Khalil. Nonlinear Systems (3d edition). Prentice Hall, 2002. 



37 



[28] S. Kirkpatrick, C. Gelatt, and M. P. Vecchi. Optimization by simulated annealing. Science, 220:671-680, 
1983. 

[29] K.J. Kitching, D.J. Cole, and D. Cebon. Performance of a semi-active damper for heavy vehicles. ASME 
Journal of Dynamic Systems Measurement and Control, 122(3):498-506, 2000. 

[30] M. Krstic, I. Kanellakopoulos, and P. Kokotovic. Nonlinear and Adaptive Control Design. Wiley and 
Sons Inc., 1995. 

[31] W. Lin and C. Qian. Adaptive control of nonlinearly parameterized systems: A nonsmooth feedback 
framework. IEEE Trans. Automatic Control, 47(5):757-773, 2002. 

[32] W. Lin and C. Qian. Adaptive control of nonlinearly parameterized systems: The smooth feedback 
case. IEEE Trans. Automatic Control, 47(8):1249-1266, 2002. 

[33] L. Ljung. System Identification: Theory for the User. Prentice-Hall, 1999. 

[34] Ai-Poh Loh, A.M. Annaswamy, and F.P. Skantze. Adaptation in the presence of general nonlinear 
parameterization: An error model approach. IEEE Trans, on Automatic Control, 44(9):1634-1652, 
1999. 

[35] E. N. Lorcnz. Deterministic nonperiodic flow. Journal of the Atmospheric Sciences, 20:130-141, 1963. 

[36] A. Loria and E. Panteley. Uniform exponential stability of linear time-varying systems: revisited. 
Systems and Control Letters, 47(1): 13-24, 2003. 

[37] A. Loria, E. Panteley, and H. Nijmcijcr. A remark on passivity-based and discontinuous control of 
uncertain nonlinear systems. Automatica, 37(9):1481-1487, 2001. 

[38] O. Maldonado, M. Markus, and B. Hess. Coexistence of three attractors and hysteresis jumps in a 
chaotic spinning top. Phys. Lett. A, 144:153-158, 1990. 

[39] J. Milnor. On the concept of attractor. Commun. Math. Phys., 99:177-195, 1985. 

[40] I. Miroshnik, V. Nikiforov, and A. Fradkov. Nonlinear and Adaptive Control of Complex Systems. 
Kluwer, 1999. 

[41] L. Moreau and E. Sontag. Balancing at the boarder of instability. Physical Review E, 68:020901 (1-4), 
2003. 

[42] L. Moreau, E. Sontag, and M. Arcak. Feedback tuning of bifurcations. Systems and Control Letters, 
50:229-239, 2003. 

[43] K. S. Narendra and A. M. Annaswamy. Stable Adaptive systems. Prentice-Hall, 1989. 

38 



[44] K. S. Narendra and P.G. Gallman. An interative method for the indentification of nonlinear systems 
using a hammerstain model. IEEE Trans, on Automatic Control, AC-ll(7):546-550, 1966. 

[45] H. Nijmcijer and A. van der Schaft. Nonlinear Dynamical Control Systems. Springer- Verlag, 1990. 

[46] A. M. Okamura, C. Richard, and M. R. Cutkosky. Feeling is believing: Using a force-feedback joystick 
to teach dynamic systems. ASEE Journal of Engineering Education, 91(3):345-349, 2002. 

[47] R. Ortega, A. Astolfi, and N. E. Barabanov. Nonlinear PI Control of Uncertain Systems: an Alternative 
to Parameter Adaptation. Systems and Control Letters, 47:259-278, 2002. 

[48] W. Oud and I.Yu. Tyukin. Sufficient conditions for synchronization in an ensemble of Hindmarsh and 
Rose neurons: passivity-based approach. In Proc. of the 6-th IF AC Symposium on Nonlinear Control 
Systems, Shtutgart, Germany, 1-3 September 2004. 

[49] H.B. Pacejka and E. Bakker. The magic formula tyre model. In Proceedings of 1-st Tyre Colloquium, 
Delft, October 1991, pages 1-18. 1993. Supplement to Vehicle System Dynamics, vol. 21. 

[50] M. Pawlak. On the series expansion approach to the identification of hammerstatin systems. IEEE 
Trans, on Automatic Control, 36(6):763-767, 1991. 

[51] I. Petersen, T. Johanscn, J. Kalkkuhl, and J. Ludemann. Wheel slip control using gain-scheduled LQ 
- LPV/LMI analysis and experimental results. In Proceedings of IEE European Control Conference, 
Cambridge, UK, September 1~4- 2003. 

[52] D.V. Prokhorov, VA. Tcrckhov, and I.Yu. Tyukin. On the applicability conditions for the algorithms 
of adaptive control in nonconvex problems. Automation and Remote Control, 63(2):262-279, 2002. 

[53] A. Raffone and C. van Leeuwen. Dynamic synchronization and chaos in an associative neural network 
with multiple active memories. Chaos, 13(3):1090-1104, 2003. 

[54] S. Sastry and M. Bodson. Adaptive Control: Stability, Convergense, and Robustness. Prentice Hall, 
1989. 

[55] E. Sontag. Some new directions in control theory inspired by systems biology. Systems Biology, 1(1):9- 
18, 2004. 

[56] A. Stotsky. Lyapunov design for convergence rate improvement in adaptive control. International 
Journal of Control, 57(2):501-504, 1993. 

[57] Y. Sucmitsu and S. Nara. A solution for two-dimensional mazes with use of chaotic dynamics in a 
recurrent neural network model. Neural Computation, 16:1943-1957, 2004. 



39 



[58] I. Y. Tyukin. Algorithms in finite form for nonlinear dynamic objects. Automation and Remote Control, 
64(6):951-974, 2003. 

[59] I. Yu. Tyukin, D. V. Prokhorov, and Cees van Leeuwen. Finite form realizations of adaptive control 
algorithms. In Proceedings of IE E European Control Conference, Cambridge, UK, September 1~4- 2003. 

[60] I. Yu. Tyukin, D.V. Prokhorov, and C. van Leeuwen. Adaptive algorithms in finite form for nonconvex 
parameterized systems with low-triangular structure, august 30 - September 1. In Proceedings of the 
8-th IF AC Workshop on Adaptation and Learning in Control and Signal Processing (ALCOSP 2004). 
Yokohama, Japan, 2004. 

[61] IYu. Tyukin, D.V. Prokhorov, and V.A. Terekhov. Adaptive control with nonconvex parameterization. 
IEEE Trans, on Automatic Control, 48(4):554-567, 2003. 

[62] C. Van Leeuwen, M. Steyvers, and M. Nooter. Stability and intermittentcy in large-scale coupled 
oscillator models for perceprual segmentation. Journal of Mathematical Psychology, 41:319-343, 1997. 

[63] V. Verdult, L. Ljung, and M. Verhaegen. Identication of composite local linear state space models using 
a projected gradient search. Int. Journal of Control, 75(16/17):1385-398, 2002. 

[64] von der Malsburg. The what and why of binding: The modeler's perspective. Neuron, 24:95-104, 1999. 

[65] R. Weigel and E.A. Jackson. Experimental implementation of migrations in multiplc-attractor systems. 
Int. J. Bifurcation Chaos Appl. Sci. Eng., 8(1): 173-178, 1998. 

[66] D. J. Wilde and C.S. Beightler. Foundation of Optimization. Prentice-Hall, 1967. 

[67] C. Wu, J.C. Houk, KY. Young, and L.E. Miller. Nonlinear damping of limb motion. In J.M. Winters 
and Woo S-L.Y., editors, Multiple Muscle Systems, pages 214-235. Springer- Verlag, 1990. 

[68] G. Zames. On the input-output stability of time- varying nonlinear feedback systems, part i: Conditions 
derived using concepts of loop gain, conicity, and passivity. IEEE Trans, on Automatic Control, AC- 
ll(2):228-238, 1966. 



40 



